-- Logs begin at Tue 2022-06-07 15:05:37 UTC, end at Tue 2022-06-07 16:15:11 UTC. -- Jun 07 15:49:52.063550 dv-cinder-844879-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 15:49:52.071622 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 15:49:52 2022] *** Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: nodename: dv-cinder-844879-2-iscsi Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: machine: x86_64 Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: clock source: unix Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: pcre jit disabled Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: detected number of CPU cores: 4 Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: current working directory: / Jun 07 15:49:52.074213 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: detected binary path: /usr/bin/uwsgi-core Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: your processes number limit is 47680 Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: your memory page size is 4096 bytes Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: detected max file descriptor number: 2048 Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: lock engine: pthread robust mutexes Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: thunder lock: enabled Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 15:49:52.075405 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 15:49:52.119994 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: Python main interpreter initialized at 0x564f3647d9c0 Jun 07 15:49:52.119994 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: python threads support enabled Jun 07 15:49:52.119994 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: your server socket listen backlog is limited to 100 connections Jun 07 15:49:52.119994 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: your mercy for graceful operations on workers is 90 seconds Jun 07 15:49:52.120331 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 15:49:52.120446 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: *** Operational MODE: preforking *** Jun 07 15:49:52.120674 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: *** uWSGI is running in multiple interpreter mode *** Jun 07 15:49:52.120674 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: spawned uWSGI master process (pid: 103229) Jun 07 15:49:52.120858 dv-cinder-844879-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 15:49:52.122567 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: spawned uWSGI worker 1 (pid: 103230, cores: 1) Jun 07 15:49:52.122567 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: spawned uWSGI worker 2 (pid: 103231, cores: 1) Jun 07 15:49:52.122567 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 15:49:53.350551 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 15:49:53.360811 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 15:49:54.068047 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:49:54.068047 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: from cryptography.utils import int_from_bytes Jun 07 15:49:54.068348 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:49:54.068348 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: from cryptography.utils import int_from_bytes Jun 07 15:49:54.070069 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:49:54.070069 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: from cryptography.utils import int_from_bytes Jun 07 15:49:54.070416 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:49:54.070416 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: from cryptography.utils import int_from_bytes Jun 07 15:49:56.654593 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 15:49:56.655137 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 15:49:56.655350 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 15:49:56.655463 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 15:49:56.655812 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 15:49:56.655906 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 15:49:56.656005 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 15:49:56.656194 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 15:49:56.656319 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.656605 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 15:49:56.656740 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.656882 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 15:49:56.657062 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.657289 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.657374 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.657619 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.657708 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.657945 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658039 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658264 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658350 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658595 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658689 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658906 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.658989 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659166 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659250 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659485 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659581 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659804 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-2-iscsi {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.659900 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660108 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660202 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660439 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660539 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660752 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.660836 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-2-iscsi {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661068 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661152 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661374 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661467 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661685 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661786 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.661985 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.662068 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.662297 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.662484 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.662629 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.662934 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663033 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663438 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663540 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663753 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.663877 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664061 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664210 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664374 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664506 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664726 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.664854 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665027 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665180 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665343 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665477 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665656 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.665798 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666028 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666173 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-2-iscsi {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666295 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666438 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666566 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666718 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.666959 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-2-iscsi {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667088 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667264 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667406 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667586 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667715 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.667909 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.668009 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.668388 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.668493 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.668700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669118 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669226 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669306 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669418 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669497 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669617 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669811 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.669934 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670131 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670260 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670451 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670582 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670752 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.670902 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671060 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671223 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671367 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671528 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671722 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671822 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.671983 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672137 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672285 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672484 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672574 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672793 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.672886 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673102 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673188 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673354 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673467 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673665 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673804 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.673989 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674084 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674269 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674364 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674584 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674682 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674856 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.674957 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675107 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675194 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675426 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675512 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675748 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.675835 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676058 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676143 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676377 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676473 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676687 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676809 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.676992 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677126 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677298 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677434 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677607 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677750 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.677968 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678106 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678239 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678386 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678517 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678638 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678813 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.678947 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679129 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679265 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679439 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679567 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679742 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.679868 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680081 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680218 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680398 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680529 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680714 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.680839 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681031 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681169 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681347 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681483 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681653 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681805 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.681960 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682088 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682264 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682398 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682574 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682701 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.682887 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683020 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683185 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683312 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683441 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683566 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683728 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.683903 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684198 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684432 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684559 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684683 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684821 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.684946 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685096 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685230 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685403 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685538 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685703 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.685842 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686011 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686138 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686318 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686458 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686624 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686760 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.686931 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687058 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687236 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687373 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687541 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687670 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687846 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.687987 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688185 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688327 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688553 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688685 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688812 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.688935 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689056 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689187 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689365 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689491 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689671 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689798 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.689974 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690097 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690279 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690415 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690585 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690717 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.690890 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691096 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691223 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691354 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691500 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691625 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691805 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.691947 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692110 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692244 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692449 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692579 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692758 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.692903 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693063 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693189 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693382 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693510 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693692 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693818 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.693973 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694108 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694286 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694421 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694713 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.694888 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695028 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695192 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695319 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695496 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695631 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695797 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.695931 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696099 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696277 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696441 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696575 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696699 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696822 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.696997 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697134 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697304 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697429 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697611 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697749 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.697914 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698056 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698263 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698397 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698520 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698650 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698820 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.698957 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.699126 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.699251 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.699974 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.700111 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.700324 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.700511 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:49:56.700663 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.700858 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.700986 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701198 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701335 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701549 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701687 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701871 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.701998 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702210 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702347 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702533 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702660 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702846 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.702985 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703157 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703294 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703471 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703599 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703791 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.703917 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704113 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704241 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704454 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704594 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704771 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.704917 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705088 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705226 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705406 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705533 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705718 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.705846 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706035 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706171 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706354 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706480 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706671 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706797 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.706981 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707117 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707301 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707428 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707635 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707763 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.707947 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708081 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708263 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708496 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708627 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708751 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.708917 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709047 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709226 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709354 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709535 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709670 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709856 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.709995 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710187 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710314 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710498 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710636 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710811 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.710938 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711119 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711253 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711431 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711568 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711740 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.711877 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712050 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712171 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712391 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712536 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712711 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.712851 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713023 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713152 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713338 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713545 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713672 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713794 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.713953 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714089 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714266 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714395 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714579 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714706 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.714889 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.715038 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.715849 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.715982 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716107 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716243 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716416 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716546 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716738 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.716868 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717050 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717178 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717361 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717492 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717671 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717799 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.717976 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718110 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718281 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718407 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718620 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718748 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.718893 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719021 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719205 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719348 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719516 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719645 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719823 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.719955 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720136 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720275 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720458 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720613 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720778 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.720907 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721090 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721232 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721408 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721535 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721725 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.721852 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722033 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722179 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722334 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722462 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722639 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722766 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.722953 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723080 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723262 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723396 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723574 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723702 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.723880 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724007 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724187 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724314 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724525 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724652 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724838 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.724972 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.725150 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.725277 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.725466 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.725604 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.725794 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.726190 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.726367 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.726494 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.726688 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.726824 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727008 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727325 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727452 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727631 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727772 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.727942 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728070 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728247 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728414 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728656 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728809 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.728935 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729059 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729181 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729304 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729468 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729596 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729774 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.729910 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730079 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730206 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730383 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730511 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730710 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.730841 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.731230 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.731358 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.731625 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.731829 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.731958 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.732244 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.732389 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.732601 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.732743 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.732920 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733059 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733231 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733367 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733543 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733671 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733854 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.733991 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734203 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734339 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734514 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734643 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734860 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.734996 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735178 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735336 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735471 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735596 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735779 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.735911 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736093 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736221 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736429 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736572 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736745 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.736873 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737062 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737188 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737370 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737497 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737680 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737807 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.737987 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738123 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738305 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738445 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738611 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738746 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.738944 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739080 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739206 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739335 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739514 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739641 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739851 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.739987 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740162 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740298 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740501 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740622 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740824 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.740963 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741135 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741265 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741448 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741575 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741756 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.741885 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742067 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742194 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742375 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742504 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742686 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.742821 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743000 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743126 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743311 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743437 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743637 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743762 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.743925 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744053 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744235 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744408 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744553 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744678 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744870 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.744998 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745174 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745301 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745487 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745615 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745805 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.745930 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.746113 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.746250 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.746951 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.747096 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.747265 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.747559 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.747688 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.747884 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748012 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748192 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748321 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748530 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748660 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748837 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.748979 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749170 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749307 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749432 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749563 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749734 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.749870 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750042 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750177 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750350 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750491 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750653 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750789 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.750966 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751101 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751272 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751408 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751575 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751711 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.751880 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752005 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752188 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752326 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752534 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752662 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752844 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.752983 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753163 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753304 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753481 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753609 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753783 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.753911 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754085 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754213 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754411 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754540 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754719 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.754855 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755021 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755157 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755346 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755482 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755606 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755736 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.755943 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756079 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756248 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756422 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756580 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756708 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.756888 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757017 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757203 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757332 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757511 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757649 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757823 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.757951 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758132 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758270 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758440 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758586 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758750 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.758887 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759060 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759201 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759389 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759531 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759664 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759788 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.759953 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760082 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760260 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760427 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760596 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760724 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.760915 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761049 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761218 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761352 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761527 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761655 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.761835 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.762560 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.762697 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.762823 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763005 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763140 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763322 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763458 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763735 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.763886 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764047 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764226 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764389 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764569 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764711 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.764887 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765205 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765334 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765523 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765662 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765851 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.765980 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766178 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766305 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766499 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766644 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766808 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.766952 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767116 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767244 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767421 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767551 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767725 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.767854 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768034 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768172 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768339 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768492 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768665 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.768874 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769010 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769259 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769407 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769601 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769738 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769872 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.769996 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770120 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770244 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770410 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770552 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770725 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.770854 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771027 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771162 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771337 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771474 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771640 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771768 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.771957 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772083 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772261 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772449 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772577 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.772876 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773004 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773178 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773308 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773498 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773624 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773806 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.773933 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774253 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774419 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774553 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774765 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.774901 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775068 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775195 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775370 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775498 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775691 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775828 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.775996 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776124 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776298 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776444 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776630 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776769 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.776927 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777060 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777232 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777360 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777548 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777699 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.777897 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778061 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778190 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778383 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778520 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.778829 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779012 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779125 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779330 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779468 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779649 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779769 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.779958 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780068 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780266 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780395 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780595 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780896 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.780984 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781199 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781295 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781502 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781588 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781802 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.781896 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782108 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782203 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782407 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782492 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782716 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.782801 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783015 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783110 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783316 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783402 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783620 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783706 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.783920 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784006 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784230 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784316 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784559 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784645 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784878 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.784965 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785186 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785286 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785489 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785788 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.785875 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786090 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786174 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786388 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786483 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786691 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786777 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.786998 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787084 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787300 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787394 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787612 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787706 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787911 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.787995 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788213 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788323 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788548 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788648 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788851 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.788938 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789153 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789253 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789461 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789549 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789763 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.789856 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790064 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790152 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790363 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790455 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790663 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790751 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.790965 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791052 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791266 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791350 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791570 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791663 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791868 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.791954 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792168 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792252 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792490 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792579 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792812 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.792898 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793122 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793225 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793456 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793609 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793759 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.793963 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794050 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794308 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794402 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794629 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794716 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.794941 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795026 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795250 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795335 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795565 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795664 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795865 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.795952 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796179 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796268 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796527 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796627 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796841 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.796927 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797141 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797227 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797443 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797532 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797756 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.797848 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798062 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798160 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798368 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798472 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798675 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798768 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.798990 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799084 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799302 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799391 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799601 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799686 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.799909 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800005 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800218 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800304 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800565 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800653 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800872 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.800975 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801177 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801262 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801484 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801577 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801792 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.801885 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802099 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802184 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802409 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802506 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802715 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.802802 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803019 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803104 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803415 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803636 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803723 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.803939 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804025 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804245 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804684 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804886 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.804971 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805194 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805289 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805497 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805597 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805807 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.805903 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806106 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806201 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806416 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806528 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806727 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.806840 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807042 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807138 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807350 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807436 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807733 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.807818 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.808040 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.808134 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.808385 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.808472 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.808707 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.809285 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.809576 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.809664 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.809988 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810079 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810295 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810393 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810590 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810686 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810899 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.810991 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.811200 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.811355 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.811503 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.811675 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.811812 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812012 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812348 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812524 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812705 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.812791 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813033 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813118 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813350 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813436 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813653 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813738 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.813970 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814054 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814278 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814364 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814674 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.814916 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815001 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815227 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815361 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815572 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815665 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.815964 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816069 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816281 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816393 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816642 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816731 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.816962 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817090 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817265 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817422 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817576 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817739 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.817884 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818068 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818205 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818396 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818528 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818724 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.818835 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819035 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819146 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819355 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819442 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819672 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.819765 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820004 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820139 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820336 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820444 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820673 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820762 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.820994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821088 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821303 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821391 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821632 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821719 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.821961 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822057 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822282 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822368 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822584 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822677 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.822888 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823044 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823197 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823336 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823500 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823654 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823804 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.823980 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.824123 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.824308 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.824530 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.825303 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.825400 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.825611 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.825698 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.825924 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826034 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826228 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826337 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826533 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826629 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826853 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.826955 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827158 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827261 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827473 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827565 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827783 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.827875 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828095 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828196 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828427 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828533 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828733 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.828833 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829054 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829156 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829362 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829463 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829661 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829752 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.829964 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830057 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830268 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830382 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830610 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830714 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.830914 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831007 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831233 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831334 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831542 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831633 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831852 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.831945 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832161 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832255 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832495 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832589 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832827 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.832924 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833138 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833229 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833451 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833555 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833775 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.833868 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834079 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834171 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834383 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834485 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834697 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.834790 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835002 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835095 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835306 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835408 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835607 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.835914 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836007 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836214 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836307 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836542 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836636 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836844 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.836936 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837158 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837249 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837456 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837548 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837760 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.837851 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838072 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838161 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838364 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838456 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838666 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838758 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.838964 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839055 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839287 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839379 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839593 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839698 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.839918 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840015 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840263 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840424 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840599 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840773 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.840909 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841109 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841208 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841421 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841545 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841748 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.841844 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842064 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842175 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842378 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842497 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842694 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.842821 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843010 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843152 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843325 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843467 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843640 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843795 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.843956 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844117 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844265 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844461 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844613 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844783 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.844929 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.845102 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.845246 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.845412 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.845725 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.845811 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846045 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846147 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846362 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846473 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846678 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846764 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.846996 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847082 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847312 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847411 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847627 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847834 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.847941 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848170 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848265 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848516 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848606 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848840 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.848942 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849157 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849266 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849478 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849571 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849793 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.849887 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850108 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850210 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850430 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850522 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850744 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.850842 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.851321 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.851411 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.851634 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.851719 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.851965 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852051 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852288 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852411 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852624 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852712 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.852940 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853107 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853256 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853344 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853570 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853655 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853876 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.853971 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854186 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854274 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854500 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854588 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854819 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.854907 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855130 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855224 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855457 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855550 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855786 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.855920 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.856101 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.856452 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.856562 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.856773 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.856874 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857092 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857187 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857405 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857492 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857718 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.857814 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858031 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858117 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858353 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858544 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858673 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.858859 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859007 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859192 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859350 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859513 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859674 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859835 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.859992 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.860151 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.860311 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.860493 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.860660 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.860818 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861124 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861217 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861428 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861529 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.861824 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862131 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862347 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862442 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862665 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862752 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.862973 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863059 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863275 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863369 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863592 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863678 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863899 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.863986 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.864238 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.864451 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.864587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.864801 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.864887 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865116 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865215 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865439 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865525 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865760 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.865846 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866074 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866170 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866382 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866482 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866706 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.866918 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867005 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867266 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867353 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867587 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867673 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867894 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.867988 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868197 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868295 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868526 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868615 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868838 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.868935 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869147 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869249 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869446 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869540 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869751 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.869854 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870052 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870144 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870374 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870460 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870677 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870773 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.870979 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.871066 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.871803 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.871898 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.872126 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.872348 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.872488 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.872684 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.872857 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873004 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873163 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873318 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873466 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873651 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873777 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.873962 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874079 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874271 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874388 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874581 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874691 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874896 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.874995 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875206 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875291 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875513 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875606 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875823 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.875917 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876129 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876222 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876469 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876570 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876777 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.876865 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877091 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877180 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877401 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877488 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877716 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.877804 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878023 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878120 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878333 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878420 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878679 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.878995 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879081 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879299 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879524 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879619 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879855 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.879942 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880175 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880263 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880533 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880623 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880853 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.880939 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881158 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881244 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881463 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881550 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881766 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.881853 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882087 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882333 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882429 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882671 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882757 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.882982 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883075 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883291 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883379 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883598 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883684 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883906 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.883992 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884214 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884301 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884547 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884633 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884854 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.884943 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885168 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885263 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885475 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885563 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885782 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.885876 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886089 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886177 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886399 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886486 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886714 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.886814 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.887586 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.887694 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.887906 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888153 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888277 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888502 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888592 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888823 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.888919 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889139 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889226 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889445 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889532 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889752 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.889839 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890066 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890166 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890390 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890479 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890701 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.890787 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891003 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891099 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891334 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891420 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891657 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891744 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.891973 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892067 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892285 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892406 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892626 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892712 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.892941 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893036 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893258 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893348 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893566 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893659 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893887 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.893975 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894194 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894279 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894516 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894601 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894850 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.894938 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895269 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895503 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895598 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895806 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.895893 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896110 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896196 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896455 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896565 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896749 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.896844 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897064 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897151 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897369 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897464 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897669 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897754 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.897969 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898063 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898276 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898372 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898576 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898686 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898876 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.898998 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899176 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899309 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899477 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899782 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.899932 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900080 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900255 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900414 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900600 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900701 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.900916 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901012 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901224 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901359 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901562 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901649 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.901957 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902163 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902253 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902465 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902571 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902849 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.902975 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903161 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903248 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903466 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903552 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903777 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.903872 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904083 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904170 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904414 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904517 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904772 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.904867 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905035 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905121 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905348 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905445 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905655 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905748 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.905960 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906268 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906363 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906576 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906663 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906879 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.906964 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907206 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907300 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907517 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907604 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907829 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.907916 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908138 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908233 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908471 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908574 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908781 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.908870 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909092 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909179 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909411 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909496 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909730 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.909822 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910035 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910124 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910346 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910431 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910659 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910746 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.910976 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911063 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911290 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911376 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911598 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911697 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911911 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.911997 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912219 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912305 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912552 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912725 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912867 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.912961 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913174 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913262 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913482 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913581 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913795 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.913889 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914106 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914200 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914427 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914514 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914745 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.914833 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915051 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915137 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915378 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915465 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915690 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.915775 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916006 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916093 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916326 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916509 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916666 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916764 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.916984 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917072 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917295 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917382 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917604 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917691 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.917907 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.918006 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.918147 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 15:49:56.918269 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.918573 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.918906 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.919242 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.919591 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.919906 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.920255 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.920610 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.920935 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.921253 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.921563 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:49:56.921807 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 15:49:56.976919 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO dbcounter [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Registered counter for database nova_api Jun 07 15:49:56.985380 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO dbcounter [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Registered counter for database nova_api Jun 07 15:49:56.998474 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_db.sqlalchemy.engines [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.005043 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writer thread running {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.005175 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_db.sqlalchemy.engines [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.011481 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writer thread running {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.062159 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.context [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9e0058-8556-4496-a4e0-0705454b303e(cell1) {{(pid=103230) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 15:49:57.066253 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_concurrency.lockutils [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:49:57.067832 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_concurrency.lockutils [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:49:57.068629 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_concurrency.lockutils [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:49:57.068787 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.context [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9e0058-8556-4496-a4e0-0705454b303e(cell1) {{(pid=103231) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 15:49:57.070580 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_concurrency.lockutils [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:49:57.072565 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO dbcounter [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Registered counter for database nova_cell0 Jun 07 15:49:57.072863 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:49:57.074498 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:49:57.075371 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:49:57.076811 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO dbcounter [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Registered counter for database nova_cell1 Jun 07 15:49:57.077362 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:49:57.079319 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO dbcounter [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Registered counter for database nova_cell0 Jun 07 15:49:57.083306 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO dbcounter [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Registered counter for database nova_cell1 Jun 07 15:49:57.084680 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_db.sqlalchemy.engines [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.085910 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_db.sqlalchemy.engines [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.090735 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_db.sqlalchemy.engines [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.091994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_db.sqlalchemy.engines [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.092573 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writer thread running {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.097743 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writer thread running {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.099589 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writer thread running {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.099934 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writer thread running {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.240191 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO dbcounter [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Registered counter for database nova_cell0 Jun 07 15:49:57.246867 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG oslo_db.sqlalchemy.engines [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.249646 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO dbcounter [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Registered counter for database nova_cell0 Jun 07 15:49:57.251197 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writer thread running {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.256544 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_db.sqlalchemy.engines [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:49:57.260787 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writer thread running {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:49:57.713438 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: WARNING keystonemiddleware.auth_token [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:49:57.714260 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: WARNING keystonemiddleware.auth_token [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:49:57.721474 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: WARNING keystonemiddleware.auth_token [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:49:57.722124 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: WARNING keystonemiddleware.auth_token [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:49:57.947489 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: WARNING keystonemiddleware.auth_token [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:49:57.953732 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: WARNING keystonemiddleware.auth_token [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:49:57.958887 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f3647d9c0 pid: 103231 (default app) Jun 07 15:49:57.960281 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: WARNING keystonemiddleware.auth_token [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:49:57.962045 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:49:57.963209 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002783 Jun 07 15:49:57.963679 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Jun 7 15:49:57 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:49:57.966610 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: WARNING keystonemiddleware.auth_token [None req-3af54c6a-f97a-4cff-9a2a-b8416fd871d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:49:57.971629 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f3647d9c0 pid: 103230 (default app) Jun 07 15:51:17.210989 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:17.212049 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 07 15:51:17.212528 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:17.230722 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_api:SELECT=3 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:17.231669 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_cell0:SELECT=3 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:17.232704 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_cell1:SELECT=3 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:17.233517 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:17.674841 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-9076af4f-211f-43ff-83b9-926f81d50324 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:17.706201 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-9076af4f-211f-43ff-83b9-926f81d50324 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485644 Jun 07 15:51:17.720417 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 7 15:51:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:20.043410 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:20.044704 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0056abaf-56f0-4e09-8fac-cb657f9d7464 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jun 07 15:51:20.045341 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:20.112780 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-e28be209-4036-45a0-b842-d952bc4c9097 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:20.131315 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:51:20.131315 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: warnings.warn(msg) Jun 07 15:51:20.161472 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-e28be209-4036-45a0-b842-d952bc4c9097 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110345 Jun 07 15:51:20.162137 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:20.176120 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_api:SELECT=3 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:20.177283 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_cell0:SELECT=3 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:20.177999 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_cell1:SELECT=3 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:20.178705 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:51:20.404732 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-2a03a73d-c9b7-46e4-a768-3b43c7a64284 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:20.407167 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:51:20.407167 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:51:20.473723 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-2a03a73d-c9b7-46e4-a768-3b43c7a64284 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302578 Jun 07 15:51:20.484463 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 7 15:51:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:22.828968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-e28be209-4036-45a0-b842-d952bc4c9097 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:22.830041 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-e28be209-4036-45a0-b842-d952bc4c9097 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 07 15:51:22.830443 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:22.935104 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-b519d69a-33f0-4513-98c4-bee36568b160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:22.953435 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:51:22.953435 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:51:22.972176 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-b519d69a-33f0-4513-98c4-bee36568b160 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135861 Jun 07 15:51:22.972872 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:22.984974 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-306d19c6-0ed5-4168-a72f-e97654c5ab97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:22.986500 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:51:22.986500 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: warnings.warn(msg) Jun 07 15:51:23.018999 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-306d19c6-0ed5-4168-a72f-e97654c5ab97 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037710 Jun 07 15:51:23.019509 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 7 15:51:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:25.650664 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-b519d69a-33f0-4513-98c4-bee36568b160 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:25.652700 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-b519d69a-33f0-4513-98c4-bee36568b160 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003102 Jun 07 15:51:25.653964 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:51:25.714952 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-76f9ff5c-836a-4dff-94fa-f8956a267b30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:25.737466 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-76f9ff5c-836a-4dff-94fa-f8956a267b30 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076871 Jun 07 15:51:25.738041 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:25.751640 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-f7868616-f2c8-4454-9a50-edba6cb42db0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:25.778853 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-f7868616-f2c8-4454-9a50-edba6cb42db0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031337 Jun 07 15:51:25.779836 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 7 15:51:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:28.189115 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-76f9ff5c-836a-4dff-94fa-f8956a267b30 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:28.190137 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-76f9ff5c-836a-4dff-94fa-f8956a267b30 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jun 07 15:51:28.190550 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:28.254596 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0e13eab4-e11e-4d39-832e-698e1cf1bf36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:28.274941 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0e13eab4-e11e-4d39-832e-698e1cf1bf36 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078608 Jun 07 15:51:28.275501 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:28.287703 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-1292cd67-4afb-4092-8776-1a2d51fd8e39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:28.312369 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-1292cd67-4afb-4092-8776-1a2d51fd8e39 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028392 Jun 07 15:51:28.313146 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 7 15:51:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:30.642305 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0e13eab4-e11e-4d39-832e-698e1cf1bf36 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:30.643322 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0e13eab4-e11e-4d39-832e-698e1cf1bf36 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 15:51:30.643734 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:30.703581 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "ram": 4096, "name": "ds4G"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:30.721914 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072273 Jun 07 15:51:30.722556 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:30.734758 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-b694df5b-ce59-4674-a297-1771a55d8aa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:30.762921 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-b694df5b-ce59-4674-a297-1771a55d8aa9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031743 Jun 07 15:51:30.763510 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 7 15:51:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:33.112940 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:33.113964 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 07 15:51:33.114367 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:33.185383 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-3b89e483-147e-48a4-a454-4ab2697a4149 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:33.210273 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-3b89e483-147e-48a4-a454-4ab2697a4149 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089105 Jun 07 15:51:33.211015 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 7 15:51:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:51:35.623174 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:35.624195 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-cdccb231-3bc4-480d-828d-fc0152fedd93 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 07 15:51:35.624644 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:35.685595 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-afe441cd-d295-418c-a88b-32740b27e885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:35.706905 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-afe441cd-d295-418c-a88b-32740b27e885 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076531 Jun 07 15:51:35.707549 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:35.719954 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-93c70b2f-41eb-43d0-acbd-0b1061ae4e13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:35.742652 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-93c70b2f-41eb-43d0-acbd-0b1061ae4e13 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026381 Jun 07 15:51:35.743232 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 7 15:51:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:38.039903 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-afe441cd-d295-418c-a88b-32740b27e885 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:38.041293 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-afe441cd-d295-418c-a88b-32740b27e885 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Jun 07 15:51:38.041887 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:38.112631 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-cac8042c-f914-4b1f-9a61-ffd121425bbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:38.130552 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-cac8042c-f914-4b1f-9a61-ffd121425bbf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082704 Jun 07 15:51:38.131135 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 15:51:38.143773 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-2e9c4b2c-7b33-4f9e-80d4-c78e9500983d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:38.168733 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-2e9c4b2c-7b33-4f9e-80d4-c78e9500983d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028681 Jun 07 15:51:38.169306 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 7 15:51:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:40.751824 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-cac8042c-f914-4b1f-9a61-ffd121425bbf admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:40.752952 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-cac8042c-f914-4b1f-9a61-ffd121425bbf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 07 15:51:40.753432 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:40.812489 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-fdd95832-d98f-4750-886c-917e8d65ba39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "disk": 40, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:40.831334 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-fdd95832-d98f-4750-886c-917e8d65ba39 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072054 Jun 07 15:51:40.832062 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:40.844405 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-dcaf9f8d-2c14-46e0-9108-c943fe43d70f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:40.866898 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-dcaf9f8d-2c14-46e0-9108-c943fe43d70f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026311 Jun 07 15:51:40.867472 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 7 15:51:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:43.208860 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-fdd95832-d98f-4750-886c-917e8d65ba39 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:43.210027 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-fdd95832-d98f-4750-886c-917e8d65ba39 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jun 07 15:51:43.210493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:43.268732 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-2cbd5c70-d6ab-4ec6-bdb9-309a42ec50c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "id": "4", "vcpus": 4, "ram": 8192}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:43.289898 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-2cbd5c70-d6ab-4ec6-bdb9-309a42ec50c2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072726 Jun 07 15:51:43.290468 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:43.302889 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-e507658a-3388-4f75-8b90-3e750200113d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:43.327421 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-e507658a-3388-4f75-8b90-3e750200113d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028064 Jun 07 15:51:43.328512 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 7 15:51:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:51:45.676870 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-2cbd5c70-d6ab-4ec6-bdb9-309a42ec50c2 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:51:45.678472 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-2cbd5c70-d6ab-4ec6-bdb9-309a42ec50c2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Jun 07 15:51:45.678869 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:51:45.748084 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 16384}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:45.767404 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082732 Jun 07 15:51:45.767966 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 7 15:51:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:51:45.785332 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-89dc525e-baca-4c9f-b33d-2c764df15b68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:51:45.813577 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-89dc525e-baca-4c9f-b33d-2c764df15b68 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032322 Jun 07 15:51:45.814175 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 7 15:51:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:52:10.168948 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:10.169969 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 07 15:52:10.170377 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:10.180887 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:52:10.230382 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-51737be5-02e3-44aa-8e42-60fa5527f1ec admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:10.248779 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-51737be5-02e3-44aa-8e42-60fa5527f1ec admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072416 Jun 07 15:52:10.249257 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 7 15:52:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:11.244637 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:11.245655 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-abe5ef0b-5fa1-4006-844d-0a0f65104aaa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 07 15:52:11.246134 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:11.456559 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a93f4b3e-1fe4-419c-9b63-24556ba31d28 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:11.462109 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.wsgi [None req-a93f4b3e-1fe4-419c-9b63-24556ba31d28 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a93f4b3e-1fe4-419c-9b63-24556ba31d28 admin admin] Request method failure captured: Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept: application/json Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept-Encoding: gzip, deflate Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Connection: keep-alive Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Content-Length: 0 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Host: 10.222.0.18 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-System-Scope: None Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: User-Agent: python-novaclient Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Auth-Token: gAAAAABin3Qrr3Q-zJoAFVDkEhQ3qkrQHz3anEdge9ge-wOCU4ax3QuG_T8e-oSSTap8X0bRpOWQmiY4hcQ837VMeGhQJslPkeCZQA7-axsa49XdSqcjW6Suv-ioAavAdu1bRSb2ZwlwZ1ovGA6Vyao2iIKYqC0hay7VOH_l0yiTNb5KAvMzqBQ Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Id: None Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Name: None Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Identity-Status: Confirmed Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Is-Admin-Project: True Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Id: default Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Name: Default Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Name: admin Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Role: reader,member,admin Jun 07 15:52:11.465352 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Roles: reader,member,admin Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant: admin Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Name: admin Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User: admin Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Id: default Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Name: Default Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Name: admin Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: method: > Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: exception: Flavor 42 could not be found. Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: action_args: {'id': '42'} Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:11.467045 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:11.468244 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.469736 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a93f4b3e-1fe4-419c-9b63-24556ba31d28 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:11.471026 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a93f4b3e-1fe4-419c-9b63-24556ba31d28 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061839 Jun 07 15:52:11.471026 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 7 15:52:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:11.476895 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-70db26e4-2241-4f57-80c1-319261064be8 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:11.480413 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:52:11.502672 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-70db26e4-2241-4f57-80c1-319261064be8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029708 Jun 07 15:52:11.503235 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:11.514000 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-9ffdf693-52e2-4399-864d-a3f5bac94794 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:11.535305 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-9ffdf693-52e2-4399-864d-a3f5bac94794 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024815 Jun 07 15:52:11.535871 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:11.546586 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0723e1cc-8f74-4230-ad18-e88a7ed08873 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:11.552687 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.wsgi [None req-0723e1cc-8f74-4230-ad18-e88a7ed08873 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0723e1cc-8f74-4230-ad18-e88a7ed08873 admin admin] Request method failure captured: Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept: application/json Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept-Encoding: gzip, deflate Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Connection: keep-alive Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Content-Length: 0 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Host: 10.222.0.18 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-System-Scope: None Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: User-Agent: python-novaclient Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Auth-Token: gAAAAABin3Qrr3Q-zJoAFVDkEhQ3qkrQHz3anEdge9ge-wOCU4ax3QuG_T8e-oSSTap8X0bRpOWQmiY4hcQ837VMeGhQJslPkeCZQA7-axsa49XdSqcjW6Suv-ioAavAdu1bRSb2ZwlwZ1ovGA6Vyao2iIKYqC0hay7VOH_l0yiTNb5KAvMzqBQ Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Id: None Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Name: None Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Identity-Status: Confirmed Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Is-Admin-Project: True Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Id: default Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Name: Default Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Name: admin Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Role: reader,member,admin Jun 07 15:52:11.556493 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Roles: reader,member,admin Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant: admin Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Name: admin Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User: admin Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Id: default Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Name: Default Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Name: admin Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: method: > Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: exception: Flavor 42 could not be found. Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: action_args: {'id': '42'} Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:11.558032 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:11.559002 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:11.560133 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-0723e1cc-8f74-4230-ad18-e88a7ed08873 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:11.561213 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-0723e1cc-8f74-4230-ad18-e88a7ed08873 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015488 Jun 07 15:52:11.561213 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 7 15:52:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:12.466727 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-9ffdf693-52e2-4399-864d-a3f5bac94794 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:12.467755 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-9ffdf693-52e2-4399-864d-a3f5bac94794 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 07 15:52:12.468149 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:12.657275 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-fefcc61a-ee23-4ca9-a023-a9aefdeeb2bc admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:12.662597 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.wsgi [None req-fefcc61a-ee23-4ca9-a023-a9aefdeeb2bc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-fefcc61a-ee23-4ca9-a023-a9aefdeeb2bc admin admin] Request method failure captured: Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept: application/json Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept-Encoding: gzip, deflate Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Connection: keep-alive Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Content-Length: 0 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Host: 10.222.0.18 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-System-Scope: None Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: User-Agent: python-novaclient Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Auth-Token: gAAAAABin3QsI_sqdMadr_VbZYnLNmlLdkiA2MfhWary659s-E_vVcIWZUZrUbj1LzHNYzKoBmu0eZoDawERBnh0ift1fOiQFOKCho-mjYGfccxzn12CsMyCG6KGW6LHS38pySI9eBqXORpK-ppvAk2y5E_EbJEmp14pxB4Wi_34mwehIhtHfpk Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Id: None Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Name: None Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Identity-Status: Confirmed Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Is-Admin-Project: True Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Id: default Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Name: Default Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Name: admin Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Role: reader,member,admin Jun 07 15:52:12.664092 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Roles: reader,member,admin Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant: admin Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Name: admin Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User: admin Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Id: default Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Name: Default Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Name: admin Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: method: > Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: exception: Flavor 84 could not be found. Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: action_args: {'id': '84'} Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:12.666135 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:12.666949 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.667994 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-fefcc61a-ee23-4ca9-a023-a9aefdeeb2bc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:12.669103 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-fefcc61a-ee23-4ca9-a023-a9aefdeeb2bc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060747 Jun 07 15:52:12.669103 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 7 15:52:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:12.676345 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-6d823f3a-e9ad-45e6-88c1-1abc87b3de3a admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:12.690408 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-6d823f3a-e9ad-45e6-88c1-1abc87b3de3a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017679 Jun 07 15:52:12.690932 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:12.700184 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-575f8cfd-8246-4085-83b0-6c277c7a6289 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:12.714211 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-575f8cfd-8246-4085-83b0-6c277c7a6289 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017666 Jun 07 15:52:12.714727 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:12.723420 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-37407e87-868d-4cf4-acc6-c3bf86630897 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:12.729580 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.wsgi [None req-37407e87-868d-4cf4-acc6-c3bf86630897 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-37407e87-868d-4cf4-acc6-c3bf86630897 admin admin] Request method failure captured: Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept: application/json Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept-Encoding: gzip, deflate Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Connection: keep-alive Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Content-Length: 0 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Host: 10.222.0.18 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-System-Scope: None Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: User-Agent: python-novaclient Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Auth-Token: gAAAAABin3QsI_sqdMadr_VbZYnLNmlLdkiA2MfhWary659s-E_vVcIWZUZrUbj1LzHNYzKoBmu0eZoDawERBnh0ift1fOiQFOKCho-mjYGfccxzn12CsMyCG6KGW6LHS38pySI9eBqXORpK-ppvAk2y5E_EbJEmp14pxB4Wi_34mwehIhtHfpk Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Id: None Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Name: None Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Identity-Status: Confirmed Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Is-Admin-Project: True Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Id: default Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Name: Default Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Name: admin Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Role: reader,member,admin Jun 07 15:52:12.731182 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Roles: reader,member,admin Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant: admin Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Name: admin Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User: admin Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Id: default Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Name: Default Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Name: admin Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: method: > Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: exception: Flavor 84 could not be found. Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: action_args: {'id': '84'} Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:12.732847 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:12.733968 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:12.735016 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-37407e87-868d-4cf4-acc6-c3bf86630897 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:12.736055 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-37407e87-868d-4cf4-acc6-c3bf86630897 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012537 Jun 07 15:52:12.736055 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 7 15:52:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:13.595326 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-575f8cfd-8246-4085-83b0-6c277c7a6289 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:13.596328 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-575f8cfd-8246-4085-83b0-6c277c7a6289 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 07 15:52:13.596768 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:13.784013 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-0d912b1b-d6d9-450c-8453-3d5832e1e290 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:13.790656 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.wsgi [None req-0d912b1b-d6d9-450c-8453-3d5832e1e290 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-0d912b1b-d6d9-450c-8453-3d5832e1e290 admin admin] Request method failure captured: Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept: application/json Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Accept-Encoding: gzip, deflate Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Connection: keep-alive Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Content-Length: 0 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Host: 10.222.0.18 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Openstack-System-Scope: None Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: User-Agent: python-novaclient Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Auth-Token: gAAAAABin3Qt0VVOeSMkL2ZLJnx4zdG_MKTpOeGOf64WrtOUesOwnFpTzuX4A_KiDGm7TgUxHNaNrP3GYb7y_MsyQnUDT9tF0kYy00oWE5U_INBTxjnbkhFO1OD2OUVmbM2urGJ7P4HgXexpi75KfsoUt7rTvCRqfPLjAg5KJ8C5txUDQgb08ZE Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Id: None Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Domain-Name: None Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Identity-Status: Confirmed Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Is-Admin-Project: True Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Id: default Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Domain-Name: Default Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Project-Name: admin Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Role: reader,member,admin Jun 07 15:52:13.792329 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Roles: reader,member,admin Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant: admin Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-Tenant-Name: admin Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User: admin Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Id: default Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Domain-Name: Default Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: X-User-Name: admin Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: method: > Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: exception: Flavor 451 could not be found. Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: action_args: {'id': '451'} Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:13.793863 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:13.795133 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.796518 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-0d912b1b-d6d9-450c-8453-3d5832e1e290 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:13.797766 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-0d912b1b-d6d9-450c-8453-3d5832e1e290 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059857 Jun 07 15:52:13.797766 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:13.803476 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-96c9bedf-f274-4dd7-8242-5fa79d88685b admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:13.821139 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-96c9bedf-f274-4dd7-8242-5fa79d88685b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021194 Jun 07 15:52:13.822096 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:52:13.831931 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:13.846261 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017878 Jun 07 15:52:13.846809 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 7 15:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:52:13.857324 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-28055ca2-3dba-473f-b51a-2f46f6bde80a admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:13.862626 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.wsgi [None req-28055ca2-3dba-473f-b51a-2f46f6bde80a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-28055ca2-3dba-473f-b51a-2f46f6bde80a admin admin] Request method failure captured: Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept: application/json Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Accept-Encoding: gzip, deflate Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Connection: keep-alive Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Content-Length: 0 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Host: 10.222.0.18 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-Api-Version: compute 2.90 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Openstack-System-Scope: None Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: User-Agent: python-novaclient Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Auth-Token: gAAAAABin3Qt0VVOeSMkL2ZLJnx4zdG_MKTpOeGOf64WrtOUesOwnFpTzuX4A_KiDGm7TgUxHNaNrP3GYb7y_MsyQnUDT9tF0kYy00oWE5U_INBTxjnbkhFO1OD2OUVmbM2urGJ7P4HgXexpi75KfsoUt7rTvCRqfPLjAg5KJ8C5txUDQgb08ZE Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Id: None Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Domain-Name: None Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Identity-Status: Confirmed Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Is-Admin-Project: True Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Id: default Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Domain-Name: Default Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Project-Name: admin Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Role: reader,member,admin Jun 07 15:52:13.864112 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Roles: reader,member,admin Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e30cc2a9bc04d579b04c2060b966f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e30cc2a9bc04d579b04c2060b966f87", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant: admin Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Id: 3e30cc2a9bc04d579b04c2060b966f87 Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-Tenant-Name: admin Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User: admin Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Id: default Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Domain-Name: Default Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Id: bd49b97115e3460492249a2e84a91b53 Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: X-User-Name: admin Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: method: > Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: exception: Flavor 451 could not be found. Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: action_args: {'id': '451'} Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:52:13.865767 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:13.866747 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: ERROR nova.api.openstack.wsgi Jun 07 15:52:13.868618 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-28055ca2-3dba-473f-b51a-2f46f6bde80a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:52:13.869857 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-28055ca2-3dba-473f-b51a-2f46f6bde80a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012878 Jun 07 15:52:13.869857 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 15:52:14.733700 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:14.734731 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 07 15:52:14.735125 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:14.924414 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-c4574cbe-c22a-4db3-a588-9690f4dc1120 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:52:14.942461 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-c4574cbe-c22a-4db3-a588-9690f4dc1120 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069777 Jun 07 15:52:14.943082 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 7 15:52:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 15:52:15.806185 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:15.807192 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jun 07 15:52:15.807611 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:15.996901 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-be33ef34-fc10-4b6e-bc3d-888087310ef2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:52:16.014453 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-be33ef34-fc10-4b6e-bc3d-888087310ef2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069724 Jun 07 15:52:16.014995 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 7 15:52:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:52:16.886061 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:16.887232 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Jun 07 15:52:16.887636 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:17.086422 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-cda16294-81cf-4206-880c-2f1d50b5c7ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:52:17.104238 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-cda16294-81cf-4206-880c-2f1d50b5c7ff admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069424 Jun 07 15:52:17.104825 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 7 15:52:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:52:17.972047 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:17.973084 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 07 15:52:17.973484 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:18.163039 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-35afac7b-3cf1-4246-ad6d-c1179ee91604 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:52:18.181198 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-35afac7b-3cf1-4246-ad6d-c1179ee91604 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070822 Jun 07 15:52:18.181757 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 7 15:52:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:52:19.045328 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:19.046359 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 07 15:52:19.046753 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:52:19.234589 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-62fe03f0-84fa-4971-8ff7-f79667c7cddc admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:52:19.253640 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-62fe03f0-84fa-4971-8ff7-f79667c7cddc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070477 Jun 07 15:52:19.254175 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Jun 7 15:52:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:53:20.463035 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.464070 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-a8b94335-edbf-4538-9bd9-f8204dfb1dd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 07 15:53:20.464505 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:53:20.471656 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:53:20.524148 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-440fab4b-1c41-46fc-aa4c-46f880632968 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.543397 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-440fab4b-1c41-46fc-aa4c-46f880632968 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073138 Jun 07 15:53:20.543937 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:53:20.564427 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG dbcounter [-] [103230] Writing DB stats nova_api:SELECT=14 {{(pid=103230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:53:20.568425 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-9372ec16-5270-4009-9d24-f303277eee64 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.576979 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-9372ec16-5270-4009-9d24-f303277eee64 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013998 Jun 07 15:53:20.577533 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:53:20.589883 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-77486ca3-b8ec-42b6-953b-95aabb9919ec admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.597786 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-77486ca3-b8ec-42b6-953b-95aabb9919ec admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011652 Jun 07 15:53:20.598316 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:53:20.609947 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.617624 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011252 Jun 07 15:53:20.618140 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:53:20.629333 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-59f056fa-9266-4075-8d6c-05f02ff1df17 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:53:20.638307 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-59f056fa-9266-4075-8d6c-05f02ff1df17 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012657 Jun 07 15:53:20.638841 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Jun 7 15:53:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:56:41.015219 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:41.016242 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 07 15:56:41.016698 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:56:41.195840 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_api:SELECT=6 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:56:41.316709 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:41.317905 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:56:41.317905 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:56:41.319149 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:41.319591 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:41.320395 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:41.320833 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:41.355482 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-4e6761fe-a7bf-4af2-bce3-babbde7edd52 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161308 Jun 07 15:56:41.356251 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:56:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:56:42.257685 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:42.259266 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Jun 07 15:56:42.259673 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:56:42.454429 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:42.455657 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:56:42.455657 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:56:42.456880 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:42.457322 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:42.458173 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:42.458672 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:42.479030 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-33c540cd-f85d-46b5-8bc6-c4ef012e718d admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077456 Jun 07 15:56:42.479612 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:56:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 15:56:53.793135 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:53.794143 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 07 15:56:53.794539 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:56:53.939127 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_cell0:SELECT=4 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:56:53.939832 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_cell1:SELECT=4 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:56:53.940456 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG dbcounter [-] [103231] Writing DB stats nova_api:SELECT=8 {{(pid=103231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:56:53.988643 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:53.989819 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:56:53.989819 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:56:53.990996 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:53.991433 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:53.992210 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:53.992663 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:54.018065 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-6caf3d3c-26c6-4d3e-9a79-bca571b734e3 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083869 Jun 07 15:56:54.018554 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:56:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:56:54.887707 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: DEBUG nova.api.openstack.wsgi [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] Calling method '>' {{(pid=103230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:54.888774 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: INFO nova.api.openstack.requestlog [None req-82a3f26f-bda5-4ead-9543-eb0444105197 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 07 15:56:54.889176 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: [pid: 103230|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 7 15:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:56:55.080131 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG nova.api.openstack.wsgi [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] Calling method '>' {{(pid=103231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:56:55.081372 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 15:56:55.081372 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: warnings.warn(msg) Jun 07 15:56:55.082567 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:55.083001 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:55.083779 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:56:55.084204 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: DEBUG oslo_concurrency.lockutils [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:56:55.107442 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: INFO nova.api.openstack.requestlog [None req-be70698f-9a15-4847-857c-80347a8f4f4e admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078300 Jun 07 15:56:55.108094 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: [pid: 103231|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 7 15:56:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:57:53.819746 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: Tue Jun 7 15:57:53 2022 - graceful shutdown triggered... Jun 07 15:57:53.819882 dv-cinder-844879-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 15:57:53.820841 dv-cinder-844879-2-iscsi devstack@n-api.service[103230]: Gracefully killing worker 1 (pid: 103230)... Jun 07 15:57:53.821282 dv-cinder-844879-2-iscsi devstack@n-api.service[103231]: Gracefully killing worker 2 (pid: 103231)... Jun 07 15:57:54.821956 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: worker 1 buried after 1 seconds Jun 07 15:57:54.821956 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: worker 2 buried after 1 seconds Jun 07 15:57:54.821956 dv-cinder-844879-2-iscsi devstack@n-api.service[103229]: goodbye to uWSGI. Jun 07 15:57:54.823717 dv-cinder-844879-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 15:57:54.824421 dv-cinder-844879-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 15:57:54.827247 dv-cinder-844879-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 15:57:54.845825 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 15:57:54 2022] *** Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: nodename: dv-cinder-844879-2-iscsi Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: machine: x86_64 Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: clock source: unix Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: pcre jit disabled Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: detected number of CPU cores: 4 Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: current working directory: / Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: detected binary path: /usr/bin/uwsgi-core Jun 07 15:57:54.867770 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: your processes number limit is 47680 Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: your memory page size is 4096 bytes Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: detected max file descriptor number: 2048 Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: lock engine: pthread robust mutexes Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: thunder lock: enabled Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 15:57:54.868658 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 15:57:54.915631 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: Python main interpreter initialized at 0x5647fa1a69c0 Jun 07 15:57:54.915631 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: python threads support enabled Jun 07 15:57:54.915631 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: your server socket listen backlog is limited to 100 connections Jun 07 15:57:54.915631 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: your mercy for graceful operations on workers is 90 seconds Jun 07 15:57:54.916066 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 15:57:54.916066 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: *** Operational MODE: preforking *** Jun 07 15:57:54.916338 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: *** uWSGI is running in multiple interpreter mode *** Jun 07 15:57:54.916338 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: spawned uWSGI master process (pid: 117805) Jun 07 15:57:54.916571 dv-cinder-844879-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 15:57:54.917427 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: spawned uWSGI worker 1 (pid: 117818, cores: 1) Jun 07 15:57:54.917558 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: spawned uWSGI worker 2 (pid: 117819, cores: 1) Jun 07 15:57:54.917720 dv-cinder-844879-2-iscsi devstack@n-api.service[117805]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 15:57:56.158497 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 15:57:56.197857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 15:57:56.988009 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:57:56.988009 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: from cryptography.utils import int_from_bytes Jun 07 15:57:56.988882 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:57:56.988882 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: from cryptography.utils import int_from_bytes Jun 07 15:57:57.050027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:57:57.050027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: from cryptography.utils import int_from_bytes Jun 07 15:57:57.050290 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 15:57:57.050290 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: from cryptography.utils import int_from_bytes Jun 07 15:57:59.353265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 15:57:59.354093 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 15:57:59.354312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 15:57:59.354677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 15:57:59.354937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 15:57:59.355324 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.355652 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.355973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.356294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.356675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.356989 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.357311 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.357631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.357958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.358219 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.358539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.358866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-2-iscsi {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.359185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.359494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.359806 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.360123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.360451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.360775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.361081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.361576 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.362768 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.362768 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.362768 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.363011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.363320 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.363628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.363954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.364281 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.364611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.364924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.365323 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-2-iscsi {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.365638 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.365952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.366265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.366694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.366990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.367298 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.367618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.367939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.368247 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.368603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.368924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.369239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.369557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.369858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.370167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.370476 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.370791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.371093 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.371397 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.371647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.371952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.372272 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.372616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.372937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.373190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.373443 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.373758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.374081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.374389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.374697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.375004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.375309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.375615 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.375921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.376224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.376555 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.376873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.377187 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.377507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.377815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.378132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.378523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.378777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.379108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.379446 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.379763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.380068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.380409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.380731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.381038 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.381345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.381651 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.381967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.382300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.382606 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.382855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.383152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.383456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.383773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.384082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.384405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.384714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.385013 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.385321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.385624 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.385928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.386231 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.386535 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.386836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.387141 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.387443 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.387748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.388612 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.388612 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.388841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.388993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.389299 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.389604 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.389924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.390232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.390539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.390857 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.391161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.391466 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.391780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.392085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.392409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.392728 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.393027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.393333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.393647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.393960 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.394261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.395095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.395401 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.395703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.396006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.396308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.396637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.396938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.397254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.397573 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.397881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.398187 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.398490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.398808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.399145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.399479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.399819 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.400132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.400529 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.400816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.401132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.401444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.401758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.402083 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.402394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.402704 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.403015 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.403331 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.403652 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.403996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.404294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.404641 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.404961 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.405273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.405593 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.405919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.406240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.406552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.406888 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.407232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.407540 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.407863 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.408185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.408524 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.408832 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.409148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.409472 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.409798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.410732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.411059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.411371 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.411685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.411995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.412306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.412657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.412995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.413311 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.413627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.413938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.414255 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.414570 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.414881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.415191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.415495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.415801 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.416101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.416433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.416740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.417059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.417387 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.417690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.418020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.418324 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.418633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.418942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.419249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.419564 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.419868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.420174 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.420511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.420835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.421144 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.421448 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.421769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.422074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.422378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.422689 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.422999 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.423308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.423618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.423928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.424249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.424594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.424908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.425242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.425572 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.425953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.426450 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.426783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.427105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.427415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.427726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.428035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.428342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.428673 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.428985 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.429288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.429609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.429899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.430206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.430509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.430834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.431145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.431452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.431758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.432063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.432427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.432735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.433078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.433415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.433734 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.434056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.434370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.434691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.435002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.435316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.435628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.435941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.436261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.436598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.436919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.437228 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.437556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.437866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.438187 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.438492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.438807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.439142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.439472 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.439789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.440112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.440449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.440767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.441076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.441422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.441969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.442260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.442582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.442894 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.443214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.443525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.443850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.444162 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.444507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.444820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.445134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.445464 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.445796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.446109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.446418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.446739 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.447049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.447360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.447674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.447978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.448284 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.448631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.448951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.449265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.449574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.449881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.450195 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.450501 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.450806 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.451110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.451424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.451745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.452056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.452396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.452722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.453029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.453335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.453658 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.453967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.454275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.454579 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.454890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.455232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.455542 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.455847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.456166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.456516 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.456829 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.457695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.458010 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.458317 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.458639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.458953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.459263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.459577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.459889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.460198 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.460536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.460861 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.461169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.461480 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.461789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.462091 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.462400 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.462718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.463293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.463627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.463944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.464262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.464619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.464941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.465277 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.465604 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.465946 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.466252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.466559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.466865 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.467169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.467479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.467787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.468087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.468410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.468722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.469025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.469330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.469635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.469940 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.470674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.470674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.470922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.471143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.471466 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.471777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.472084 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.472412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.473362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.473684 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.473992 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.474330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.474659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.475001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.475309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.475619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.475945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.476254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.476587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.476895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.477207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.477518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.477878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.478130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.478441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.479027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.479341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.479648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.479958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.480263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.480601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.480914 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.481218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.481524 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.481837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.482147 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.482451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.482762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.483067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.483382 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.483688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.483993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.484295 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.484642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.484949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.485251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.485579 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.485889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.486193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.486495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.486804 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.487107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.487411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.487719 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.488043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.488408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.488717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.489027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.489334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.489444 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 15:57:59.489921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 15:57:59.490018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.490018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.490186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 15:57:59.490276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.490452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 15:57:59.490587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.490709 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 15:57:59.490816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.491078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.491168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.491382 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.491480 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.491683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.491781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.492005 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.492104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.492314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.492431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.492644 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.492743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.492949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.493040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.493251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.493352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.493573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.493669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.493831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.493929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.494143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.494249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.494465 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-2-iscsi {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.494559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.494783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.494918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.495086 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.495187 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.495393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.495483 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.495707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.495858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.496010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.496151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.496313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.496460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.496643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.496749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.496966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.497147 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.497263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.497454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.497568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.497754 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.497854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.498065 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.498190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.498394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.498499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.498704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.498840 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.499010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.499110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.499323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.499440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.499626 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.499745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.499946 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.500109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.500258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.500452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.500589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.500681 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-2-iscsi {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.500900 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.500995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.501209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.501310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.501518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.501609 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.501828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.501921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.502139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.502245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.502449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.502547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.502758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.502848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.503067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.503173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.503371 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.503463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.503678 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.503776 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.504163 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.504586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.504694 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.504864 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.505017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.505176 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.505350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.505477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.505568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.505783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.505875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.506087 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.506191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.506394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.506484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.506740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.506844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.506991 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.507113 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.507243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.507423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.507546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.507732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.507865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.508035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.508180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.508345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.508533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.508676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.508780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.508988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.509079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.509301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.509399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.509607 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.509719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.509910 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.510008 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.510216 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.510310 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.510520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.510663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.510824 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.510917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.511126 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.511216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.511427 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.511519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.511728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.511827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.512030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.512130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.512344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.512542 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.512845 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.512963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.512963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.513129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.513286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.513387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.513590 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.513689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.513912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.514013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.514210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.514323 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.514515 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.514633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.514849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.514955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.515162 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.515343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.515464 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.515654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.515779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.515968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.516095 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.516288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.516421 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.516638 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.516740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.516968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.517062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.517253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.517344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.517567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.517673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.517875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.517974 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.518141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.518239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.518436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.518545 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.518738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.518839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.519052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.519143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.519353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.519988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.520226 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.520577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.520697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.520896 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.521066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.521218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.521311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.521546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.521635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.521854 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.521966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.522160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.522262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.522467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.522558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.522773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.522873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.523073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.523172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.523377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.523477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.523681 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.523774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.523983 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.524082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.524298 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.524403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.524640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.524733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.524942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.525040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.525243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.525385 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.525546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.525639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.525851 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.525952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.526154 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.526244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.526456 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.526553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.526757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.526858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.527066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.527179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.527365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.527475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.527670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.527782 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.527983 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.528082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.528286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.528415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.528616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.528724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.528932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.529024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.529227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.529319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.529529 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.529670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.529834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.529933 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.530135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.530232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.530460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.530556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.530733 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.530881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.531023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.531130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.531323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.531423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.531622 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.531713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.531920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.532026 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.532220 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.532312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.532542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.532672 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.532856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.532985 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.533173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.533265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.533477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.533577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.533781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.533882 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.534080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.534179 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.534393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 15:57:59.534492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.534710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.534809 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.535014 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.535152 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.535983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.536407 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.536518 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.536721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.536814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537028 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537264 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537365 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.537936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538038 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.538976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539182 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539276 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539487 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.539906 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540472 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.540875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541514 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.541825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542352 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.542976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543291 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543607 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543708 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.543923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.544981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.545174 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.545266 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.545483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.545586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.545802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.546986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547444 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547608 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547719 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.547916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548017 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548564 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.548984 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.549919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.550152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.550250 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.550457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.550565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.550881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.551008 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.551320 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.551637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.551736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.551952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552059 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552391 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552599 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552905 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.552997 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553841 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.553931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.554885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555778 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.555986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556295 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.556941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557040 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557555 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557865 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.557954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.558164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.558260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.558467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.558687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.558785 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.559958 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560401 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.560926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561028 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561424 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561579 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561748 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.561983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562168 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562592 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562754 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.562926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563369 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563797 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.563949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564089 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564235 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564508 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564809 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.564910 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565113 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.565815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.566016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.566108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.566848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.566952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.567425 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.567740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.567841 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568487 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.568780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569406 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569596 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.569997 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.570210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.570301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.570519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.570608 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.570823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.571852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572390 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.572805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573010 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.573927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574540 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574839 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.574930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.575870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576095 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576434 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.576836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.577963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578367 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.578981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.579201 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.579309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.579502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.579753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.579843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580090 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580737 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.580826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581049 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581375 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581678 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.581775 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.582044 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.582632 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.582968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.583310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.583408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.583638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.583742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.583950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584381 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584698 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.584904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.585001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.585209 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.585338 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.585515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.585606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.586835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.587952 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588083 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588257 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588591 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.588911 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589038 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589382 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589520 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589662 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589825 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.589919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.590854 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591057 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591147 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591765 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.591966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592079 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.592940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593253 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.593877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594653 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.594968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595121 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.595971 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596723 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.596936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597025 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597554 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597644 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.597931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598535 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.598879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.599098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.599203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.599403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.599506 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.599707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600012 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600482 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.600784 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601406 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.601917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602613 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602831 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.602932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.603134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.603225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.603438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.603537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604305 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604636 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604727 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.604940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605552 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.605955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606464 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606563 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.606870 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607178 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.607790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608649 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.608953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609563 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609869 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.609982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610278 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.610931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611760 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.611876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612493 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612706 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.612809 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.613010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.613109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.613361 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.613675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.613864 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614195 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614392 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614508 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.614828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615142 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.615763 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616093 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.616976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.617911 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618417 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.618856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.619003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.619170 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.619319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.619466 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 15:57:59.619604 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.619777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.620080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.620401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.620708 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.621018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.621328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.621629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.621953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.622260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.622562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.622864 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.623172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.623474 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.623774 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.624080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.624419 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.624734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.625033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.625339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.625640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.625940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.626241 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.626545 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.626843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.627140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.627437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.627740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.628041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.628394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.628690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.630053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.630372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.630684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.631034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.631343 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.631704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.632013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.632330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.632673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.632986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.633299 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.633614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.633917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.634232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.634544 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.634857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.635179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.635466 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.635784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.636093 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.636438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.636762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.637084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.637408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.637712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.638025 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.638396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.638634 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.638977 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.639244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.639553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.639862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.640172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.640502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.640813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.641116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.641424 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.641732 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.642031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.642352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.642658 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.642958 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.643264 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.643567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.643871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.644170 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.645641 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.645960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.646272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.646577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.646888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.647200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.647514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.647829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.648137 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.648579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.648889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.649200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.649509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.649812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.650112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.650505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.650877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.651137 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.651438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.651742 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.652058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.652378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.652701 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.653113 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.653422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.653724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.654135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.654445 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.654752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.655072 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.655390 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.655710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.656015 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.656434 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.656746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.657068 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.657389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.657700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.658016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.658319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.658640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.658956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.659269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.659585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.659994 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.660912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.661229 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.661554 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.661879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.662185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.662504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.662798 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.663103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.663405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.663726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.664029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.664338 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.664667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.664976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.665279 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.665580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.665901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.666200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.666520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.666831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.667154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.667471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.667772 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.668097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.668423 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.668731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.669030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.669334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.669672 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.669974 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.670296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.670622 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.670948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.671253 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.671585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.671914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.672227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.672568 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.672888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.673190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.673490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.673797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.674098 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.674399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.674698 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.675006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.675304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.675605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.676514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.676851 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.677161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.677484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.677795 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.678101 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.678411 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.678714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.679058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.679359 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.679693 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.680010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.680276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO dbcounter [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Registered counter for database nova_api Jun 07 15:57:59.680448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.680691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.681002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.681325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.681641 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.681955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.682269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.682583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.682899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.683210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.683523 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.683829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.684141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.684477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.684795 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.685332 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.685657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.685969 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.686329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.686584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.686895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.687205 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.687513 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.687821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.688134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.688472 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.688799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.689118 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.689439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.689770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.690084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.690395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.690706 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.691017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.691888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.692670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.692985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.693300 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.693616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.693930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.694240 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.694550 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.694863 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.695180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.695589 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.695904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.696925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.696925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.696925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.697252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.697565 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.697878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.698184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.698507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.699036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.699350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.699681 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.700227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.700584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.700882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.701192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.701516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.701760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_db.sqlalchemy.engines [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.701985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.702207 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.702390 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.702797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.702991 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.703289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.703601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.703889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.704346 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.704558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.705077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.705423 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.705739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.706066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.706389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.706703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.707562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.708561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.708881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.709191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.709450 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writer thread running {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:57:59.709561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.709802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.710106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.710409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.710719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.711026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.711329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.711637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.711937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.712263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.712593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.712897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.713323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.713642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.713945 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.714247 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.714550 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.714852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.715159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.715459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.715766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.716068 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.716393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.716696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.717003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.717360 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.717682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.717985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.718286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.718606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.718912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.719229 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.719538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.719845 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.720190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.720532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.721066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.721396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.721711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.722041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.722367 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.722860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.723487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.723795 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.724117 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.724450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.724761 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.725068 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.725377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.725687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.725992 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.726300 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.726633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.726917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.727221 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.727528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.727831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.728138 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.728804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.729223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.729626 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.730011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.730393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.730776 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.731154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.731532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.732067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.732280 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.732687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.733163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.733513 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.733824 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.734319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.734713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.735119 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.735516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.735872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.736201 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.736548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.736878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.737185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.737497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.737825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.738181 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.739164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.739500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.739815 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.740125 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.740454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.740770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.741092 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.741404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.741712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.742014 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.742324 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.742628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.742930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.743232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.743535 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.743842 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.744143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.744468 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.744771 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.745077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.745376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.745679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.745984 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.746284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.746585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.746888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.747188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.747487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.747816 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.748148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.748484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.748808 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.749120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.749439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.749743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.750062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.750382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.750695 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.751001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.751430 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.751745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.752057 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.752406 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.752692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.752999 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.753317 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.753630 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.754618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.755262 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.755595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.755922 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.756248 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.756594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.756910 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.757242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.757555 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.757866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.758182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.758493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.758803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.759122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.759438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.759768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.760092 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.760420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.760747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.761071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.761415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.761729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.762073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.762397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.762710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.763021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.763327 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 15:57:59.763569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 15:57:59.766816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.context [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9e0058-8556-4496-a4e0-0705454b303e(cell1) {{(pid=117819) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 15:57:59.771637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:57:59.773188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:57:59.774023 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:57:59.776000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:57:59.778066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO dbcounter [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Registered counter for database nova_cell0 Jun 07 15:57:59.783541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO dbcounter [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Registered counter for database nova_cell1 Jun 07 15:57:59.790905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_db.sqlalchemy.engines [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.792595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_db.sqlalchemy.engines [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.797634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writer thread running {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:57:59.800836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writer thread running {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:57:59.826742 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO dbcounter [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Registered counter for database nova_api Jun 07 15:57:59.848732 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_db.sqlalchemy.engines [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.855619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writer thread running {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:57:59.916834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.context [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9e0058-8556-4496-a4e0-0705454b303e(cell1) {{(pid=117818) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 15:57:59.921116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:57:59.922691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:57:59.923537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:57:59.925520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:57:59.928305 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO dbcounter [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Registered counter for database nova_cell0 Jun 07 15:57:59.934039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO dbcounter [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Registered counter for database nova_cell1 Jun 07 15:57:59.942140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_db.sqlalchemy.engines [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.945593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_db.sqlalchemy.engines [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.949866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writer thread running {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:57:59.952837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO dbcounter [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Registered counter for database nova_cell0 Jun 07 15:57:59.960651 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_db.sqlalchemy.engines [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:57:59.965344 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writer thread running {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:58:00.095824 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writer thread running {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:58:00.106849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO dbcounter [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Registered counter for database nova_cell0 Jun 07 15:58:00.116775 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_db.sqlalchemy.engines [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 15:58:00.121655 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writer thread running {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 15:58:00.403360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: WARNING keystonemiddleware.auth_token [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:58:00.411732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: WARNING keystonemiddleware.auth_token [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:58:00.562568 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: WARNING keystonemiddleware.auth_token [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:58:00.569689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: WARNING keystonemiddleware.auth_token [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:58:00.645941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: WARNING keystonemiddleware.auth_token [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:58:00.651978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: WARNING keystonemiddleware.auth_token [None req-5941b24e-bad4-4e5f-9369-7eda33ccb4b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:58:00.657110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647fa1a69c0 pid: 117819 (default app) Jun 07 15:58:00.794364 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: WARNING keystonemiddleware.auth_token [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 15:58:00.800469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: WARNING keystonemiddleware.auth_token [None req-146e8696-5ef1-4306-a130-e9642b409004 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 15:58:00.805715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647fa1a69c0 pid: 117818 (default app) Jun 07 15:58:41.490429 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:41.491323 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:41.492411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:41.493608 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:43.310730 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b9212239-b30f-4d99-bc32-bc6629a6adcd tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Action: 'create', calling method: .version_select at 0x7f144a4645e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-968842036", "metadata": {"Type": "work"}}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:58:45.395990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b9212239-b30f-4d99-bc32-bc6629a6adcd tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.915748 Jun 07 15:58:45.396948 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 7 15:58:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3919 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 15:58:45.591899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-101880588", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "networks": [{"uuid": "df1717da-855c-4ecf-9fb8-b1f5e8b423fb"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:58:45.705166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-72f4b8a9-7d04-4442-b392-32c4b70273b6 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Calling method '.version_select at 0x7f144a6e2790>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:45.798080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:45.800436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:45.804719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:45.807611 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:45.885744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] validate_networks() for [('df1717da-855c-4ecf-9fb8-b1f5e8b423fb', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 15:58:46.547141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-72f4b8a9-7d04-4442-b392-32c4b70273b6 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e" status: 200 len: 353 microversion: 2.1 time: 1.140802 Jun 07 15:58:46.547892 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:45 2022] GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e => generated 353 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:46.553717 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-317e2a28-cb75-410c-848b-884c5fa0e75e tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a3705e0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:46.656326 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-317e2a28-cb75-410c-848b-884c5fa0e75e tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/62cda572-3cb5-412e-814c-e76d18c41c7c" status: 200 len: 350 microversion: 2.1 time: 0.106971 Jun 07 15:58:46.663578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:46 2022] GET /compute/v2.1/os-volumes/62cda572-3cb5-412e-814c-e76d18c41c7c => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:46.663578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4db9bb61-4170-4984-85ad-8b7227b147c8 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Calling method '.version_select at 0x7f144a370790>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:46.761195 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4db9bb61-4170-4984-85ad-8b7227b147c8 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e" status: 200 len: 353 microversion: 2.1 time: 0.102816 Jun 07 15:58:46.762179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:46 2022] GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:46.786483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-66a1b5a2-f864-42ef-b5d0-75f8f5f64228 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Calling method '.version_select at 0x7f144a370dc0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:46.894271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-66a1b5a2-f864-42ef-b5d0-75f8f5f64228 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e" status: 202 len: 0 microversion: 2.1 time: 0.113904 Jun 07 15:58:46.894586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 15:58:46 2022] DELETE /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 15:58:46.902496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8c5fd7d1-5c8f-46ff-8ddf-524b011c0a33 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Calling method '.version_select at 0x7f144a32b4c0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:47.069106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8c5fd7d1-5c8f-46ff-8ddf-524b011c0a33 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e" status: 200 len: 352 microversion: 2.1 time: 0.170202 Jun 07 15:58:47.069860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 5/6] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:46 2022] GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:58:47.221435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 15:58:47.223192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 15:58:47.224139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 15:58:47.224833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 15:58:47.226217 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 15:58:47.260341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:47.265014 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:47.266314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:47.268688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:47.311055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Getting quotas for project 0e7218a263864d068e82a5845e1fa739. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:58:47.321249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Getting quotas for user dfd3065e2d444dc6a4057713e738e0b4 and project 0e7218a263864d068e82a5845e1fa739. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:58:47.345619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 15:58:47.355626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 15:58:47.531847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3de62c5b-d1ba-4e65-b63b-e4385f15eedb tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089730 Jun 07 15:58:47.533178 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 2/7] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 15:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 15:58:47.543260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a2d2e83a-ed7e-4693-9b73-7b3e6a043df7 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:47.544008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a2d2e83a-ed7e-4693-9b73-7b3e6a043df7 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:47.661473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a2d2e83a-ed7e-4693-9b73-7b3e6a043df7 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:47.686634 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a2d2e83a-ed7e-4693-9b73-7b3e6a043df7 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1214 microversion: 2.1 time: 0.147020 Jun 07 15:58:47.703014 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 6/8] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:47 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:48.083958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6e956840-a065-4c1d-a34e-6692996384b9 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Calling method '.version_select at 0x7f144a24a700>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:48.147156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-6e956840-a065-4c1d-a34e-6692996384b9 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] HTTP exception thrown: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6e956840-a065-4c1d-a34e-6692996384b9 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Request method failure captured: Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e HTTP/1.1 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3WxhYRwneTXwPIeUmGm8hYIym2MPAROrtJsS_Dsxl2nxTv0FFl7mzmaQfNFpng6SAwtud_ALfjJX_ZAXfkQRR_a9oiysCbN6ENLhfkMNxj4Cdx4-mIvAB5OGhKSGaOP1vIckNxrMUgZDO7faDhfD9QfppY58GtryKsflv0MF42C6r8 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: fc49db8e3b744ef1972a6b8daff9550b Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesGetTestJSON-1024630588 Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 15:58:48.152273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc49db8e3b744ef1972a6b8daff9550b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc49db8e3b744ef1972a6b8daff9550b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc49db8e3b744ef1972a6b8daff9550b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc49db8e3b744ef1972a6b8daff9550b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesGetTestJSON-1024630588 Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: fc49db8e3b744ef1972a6b8daff9550b Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesGetTestJSON-1024630588 Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesGetTestJSON-1024630588-project Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 28ac0907283a4ba5be34011b2e8e83ec Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesGetTestJSON-1024630588-project Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'b6184776-bf32-42fb-be00-041d7007236e'} Jun 07 15:58:48.153362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. (HTTP 404) (Request-ID: req-9b0d823c-01cb-4d51-94f4-f16c96e51d87) Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:58:48.154467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 15:58:48.158439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 15:58:48.159462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6e956840-a065-4c1d-a34e-6692996384b9 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] Returning 404 to user: Volume b6184776-bf32-42fb-be00-041d7007236e could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6e956840-a065-4c1d-a34e-6692996384b9 tempest-VolumesGetTestJSON-1024630588 tempest-VolumesGetTestJSON-1024630588-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e" status: 404 len: 109 microversion: 2.1 time: 0.075890 Jun 07 15:58:48.160835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 3/9] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:48 2022] GET /compute/v2.1/os-volumes/b6184776-bf32-42fb-be00-041d7007236e => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:58:48.371377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5ab5547c-e5e7-4d2a-967e-71c0aead5776 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a2f2040>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:48.493523 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5ab5547c-e5e7-4d2a-967e-71c0aead5776 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0c5ed45b-dfdf-48fc-b0f8-9b117bf7be7c" status: 200 len: 350 microversion: 2.1 time: 0.128891 Jun 07 15:58:48.501580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:48 2022] GET /compute/v2.1/os-volumes/0c5ed45b-dfdf-48fc-b0f8-9b117bf7be7c => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:48.708366 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e49e750e-2d70-4288-996c-ed966bbb40a2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:48.709098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e49e750e-2d70-4288-996c-ed966bbb40a2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:48.988984 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e49e750e-2d70-4288-996c-ed966bbb40a2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:49.022103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e49e750e-2d70-4288-996c-ed966bbb40a2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1214 microversion: 2.1 time: 0.319489 Jun 07 15:58:49.029553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:48 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:50.050422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:50.050985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:50.063529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:50.063993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:50.064899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:50.065617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:50.273675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:50.288200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5dbc2983-bf9f-491c-a7fd-a8fb8e66a2a1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1218 microversion: 2.1 time: 0.246099 Jun 07 15:58:50.288696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:50 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:51.304291 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:51.304945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:51.312345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:51.312827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:51.313595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:51.314034 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:51.552144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0b33dff6-dc10-4ef0-a199-64b7d2bdc587 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a273e50>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:51.657844 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0b33dff6-dc10-4ef0-a199-64b7d2bdc587 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/843dd0b3-a9b6-460e-95f5-79d2f33057bd" status: 200 len: 350 microversion: 2.1 time: 0.118360 Jun 07 15:58:51.668565 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 9/13] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:58:51 2022] GET /compute/v2.1/os-volumes/843dd0b3-a9b6-460e-95f5-79d2f33057bd => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:51.676663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ae821271-bde1-49bb-9d10-86511e9c6019 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a282550>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:51.882077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ae821271-bde1-49bb-9d10-86511e9c6019 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.211455 Jun 07 15:58:51.893591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:51.893751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 10/14] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Jun 7 15:58:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:51.900582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-db9145fe-ab23-4053-a5dd-1cfaabd4398b tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a2f7790>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:51.905103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-226f76c0-d8cd-4f97-b495-00d7ca0ba193 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1210 microversion: 2.1 time: 0.604671 Jun 07 15:58:51.919599 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 5/15] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:51 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1210 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:52.295125 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-db9145fe-ab23-4053-a5dd-1cfaabd4398b tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.399661 Jun 07 15:58:52.297069 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 11/16] 10.222.0.18 () {58 vars in 1148 bytes} [Tue Jun 7 15:58:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:58:52.310430 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e72a01d1-985e-4f9a-91da-72963efb6728 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f1449147e50>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:52.608023 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e72a01d1-985e-4f9a-91da-72963efb6728 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.301244 Jun 07 15:58:52.613328 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 6/17] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Jun 7 15:58:52 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:52.625036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3f3f0030-edab-423f-a62f-e36c8174eff5 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a282ee0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:52.924587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:52.926095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:52.962424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:52.969111 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:52.970701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:52.972000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:52.981333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3f3f0030-edab-423f-a62f-e36c8174eff5 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.361063 Jun 07 15:58:52.983097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 12/18] 10.222.0.18 () {58 vars in 1166 bytes} [Tue Jun 7 15:58:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:53.003704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-03ab2454-0f1b-4233-8c74-866d34373037 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a2823a0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:53.193190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:53.202735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-26634f67-dfa9-43b6-8bfa-fa33444bc6e0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1272 microversion: 2.1 time: 0.282629 Jun 07 15:58:53.205122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 7/19] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:52 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:53.310225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-03ab2454-0f1b-4233-8c74-866d34373037 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.317743 Jun 07 15:58:53.311314 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 13/20] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Jun 7 15:58:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:58:53.324556 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cfab7b4a-5711-404a-95ba-527eb5c58980 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a2738b0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:53.562442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cfab7b4a-5711-404a-95ba-527eb5c58980 tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.241551 Jun 07 15:58:53.570322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 14/21] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Jun 7 15:58:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:58:53.576749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-88ecc2df-4784-4e55-97fb-28368837113a tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a28d5e0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:53.646357 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bce18b4e-ffd6-4ca0-bd14-5a8f0ba5ffc4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: .version_select at 0x7f14490e74c0>, body: {"keypair": {"name": "tempest-keypair-749618303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBligIly3DHYFA+/KmSiLAV/V3WtV6QUiinf/48eGTnyQeBaxcotmAzmksKyeRvCxdN1rfYRjx2oS4C/+dcA/0DpRGR2QCrJxnW1P0lmN8UlFw9DQmbbYDhNW+Qs2R0azg=="}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:58:53.685609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-bce18b4e-ffd6-4ca0-bd14-5a8f0ba5ffc4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:58:53.702586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-bce18b4e-ffd6-4ca0-bd14-5a8f0ba5ffc4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for user 8348af929ea740f3981631020a219f80 and project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:58:53.756803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-88ecc2df-4784-4e55-97fb-28368837113a tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184687 Jun 07 15:58:53.760986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 15/22] 10.222.0.18 () {58 vars in 1187 bytes} [Tue Jun 7 15:58:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:53.772033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-92780411-1ae4-4526-be1f-ff359d0e1e6e tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] Calling method '.version_select at 0x7f144a28daf0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:53.779479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bce18b4e-ffd6-4ca0-bd14-5a8f0ba5ffc4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.566721 Jun 07 15:58:53.780671 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 8/23] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 15:58:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:58:53.995547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-92780411-1ae4-4526-be1f-ff359d0e1e6e tempest-VolumesTestJSON-68045849 tempest-VolumesTestJSON-68045849-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.228549 Jun 07 15:58:53.996469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Jun 7 15:58:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:58:54.222568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:54.223372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:54.245592 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:54.252130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:54.254950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:54.257820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:54.624330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:54.665777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8cca7d32-c069-4c7a-969e-8526339036ac tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1272 microversion: 2.1 time: 0.447593 Jun 07 15:58:54.669843 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 9/25] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:54 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1272 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:55.687728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:55.688481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:55.722871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:55.726537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:55.734720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:55.738702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:56.352482 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:56.378236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-92f49368-a490-40f3-943e-f50833935508 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1272 microversion: 2.1 time: 0.694930 Jun 07 15:58:56.390582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 17/26] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:55 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1272 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:57.406183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:57.406929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:57.430422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:57.441862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:57.442326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:57.443119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:57.443536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:58.404653 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:58:58.417467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1e2d8acf-6184-47a2-99ab-6b8365f6abca tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 1.015800 Jun 07 15:58:58.432744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 10/27] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:57 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:58:59.439825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:58:59.441458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:58:59.491628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:58:59.509969 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:59.511244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:58:59.512638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:58:59.513756 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:01.258100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:01.265802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-71f77749-68f8-4b7c-b5b6-f94769dfb33f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 1.834267 Jun 07 15:59:01.271106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 18/28] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:58:59 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:02.309262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:02.316528 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:02.344074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:02.346707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:02.351955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:02.354887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:03.467028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-edba08b9-d055-43b4-aad8-3773a3ad1eac req-f0de4879-15fa-4fdd-b9aa-71c6e6a5de4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747e9c67-3bd7-4102-81a0-0e8b2ce5c396", "tag": "d96ef361-1667-48d9-adb9-586d22a99c8e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:03.532097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-edba08b9-d055-43b4-aad8-3773a3ad1eac req-f0de4879-15fa-4fdd-b9aa-71c6e6a5de4e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:03.532631 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-edba08b9-d055-43b4-aad8-3773a3ad1eac req-f0de4879-15fa-4fdd-b9aa-71c6e6a5de4e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:03.611106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-edba08b9-d055-43b4-aad8-3773a3ad1eac req-f0de4879-15fa-4fdd-b9aa-71c6e6a5de4e service nova] Creating event network-changed:d96ef361-1667-48d9-adb9-586d22a99c8e for instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 on hv-cinder-84487 Jun 07 15:59:03.612412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-edba08b9-d055-43b4-aad8-3773a3ad1eac req-f0de4879-15fa-4fdd-b9aa-71c6e6a5de4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 15:59:03.613679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:03.614119 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:03.615621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:03.615621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:03.626415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:03.644854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0b2f5355-aeb9-4f9b-a17a-dad28a2e6297 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 1.349432 Jun 07 15:59:03.645450 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 11/29] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:02 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:03.697011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.compute.rpcapi [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 15:59:03.700193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] Releasing lock "compute-rpcapi-router" {{(pid=117818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 15:59:03.806731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d101ca06-656b-4a0a-a5db-c139ad863413 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.811064 Jun 07 15:59:03.808161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 19/30] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:04.662405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:04.663044 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:04.664968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=12 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:04.688107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:04.698230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:04.705848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:04.712661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:05.707945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:05.722139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9415cd5c-1ea5-4c02-be37-564e5a524ed1 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 1.062446 Jun 07 15:59:05.725447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 12/31] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:04 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:06.041030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-633125579", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaeb9c5f-0bb1-4407-ad5c-9ab482299357"}], "security_groups": [{"name": "tempest-securitygroup--456252508"}], "key_name": "tempest-keypair-749618303", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:06.060289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f4e2b28e-bcd9-4232-a124-42b47d39e89d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: .version_select at 0x7f144a22eca0>, body: {"keypair": {"name": "tempest-keypair-1240648331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgJZwwduR1kNbfA/LQJwEhZP4Pww1d+q/Bm8wj5wkGM+pH/YlYN9RAAWPxZb8HtnmNpd/iBYij5kP1kNHWuAa8L/3N8VGiBfh2qbAXC4aUNEoBznKVI9N9ReWkgfi0cfw=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:06.243328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-f4e2b28e-bcd9-4232-a124-42b47d39e89d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:59:06.266739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-f4e2b28e-bcd9-4232-a124-42b47d39e89d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:59:06.385210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f4e2b28e-bcd9-4232-a124-42b47d39e89d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.938386 Jun 07 15:59:06.390528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 20/32] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 15:59:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:06.755843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:06.755843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:06.784794 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:06.787356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:06.791247 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:06.794254 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:07.428415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] validate_networks() for [('aaeb9c5f-0bb1-4407-ad5c-9ab482299357', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 15:59:07.790849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:07.800269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-de68306f-2bc3-4355-8d46-672a270c8174 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 1.061751 Jun 07 15:59:07.805173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 21/33] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:06 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:08.203440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-06074584-a1a3-4047-a878-87a884deb848 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Action: 'create', calling method: .version_select at 0x7f14491838b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1949413046", "metadata": {"Type": "work"}}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-06074584-a1a3-4047-a878-87a884deb848 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 122 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.228746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1949413046", "metadata": {"Type": "work"}}} Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.230141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1949413046', 'metadata': {'Type': 'work'}}}} Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise error Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.230890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 15:59:08.232016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 15:59:08.233222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 15:59:08.233222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.233222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-06074584-a1a3-4047-a878-87a884deb848 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.233222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-06074584-a1a3-4047-a878-87a884deb848 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.423697 Jun 07 15:59:08.233222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 22/34] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 7 15:59:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 426 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 15:59:08.244443 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bf80a12a-818e-4e35-a62a-9786508a5470 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Action: 'create', calling method: .version_select at 0x7f1449197e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1696184666", "metadata": {"Type": "work"}}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bf80a12a-818e-4e35-a62a-9786508a5470 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 120 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.248011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1696184666", "metadata": {"Type": "work"}}} Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.249108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1696184666', 'metadata': {'Type': 'work'}}}} Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise error Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi '0' Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.249885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 15:59:08.250959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 15:59:08.251961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 15:59:08.251961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.251961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bf80a12a-818e-4e35-a62a-9786508a5470 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.254335 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bf80a12a-818e-4e35-a62a-9786508a5470 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015251 Jun 07 15:59:08.255382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 23/35] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 7 15:59:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 15:59:08.375582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-95826ad7-cec8-4194-bedc-5965a674c5a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: .version_select at 0x7f144a224d30>, body: {"keypair": {"name": "tempest-keypair-1520162459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6LaeonTPYNsVK99vqvZ6oMjT4halEjjKVKaLjR49CyfsoTpAKkUO6SKSyxzrZ3cOjvwbmxYuLDL/PmZKiultVkrAGbZtVFhUvaHZmtF4EyDtHCqmI/V8nExpYGdM0OUA=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:08.422374 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-95826ad7-cec8-4194-bedc-5965a674c5a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for project d9f6ff4cee09476c925730a31d32e56f. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:59:08.439305 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-95826ad7-cec8-4194-bedc-5965a674c5a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for user 213a7f6737504f9eb89a2e51ddd639ff and project d9f6ff4cee09476c925730a31d32e56f. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:59:08.506913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-95826ad7-cec8-4194-bedc-5965a674c5a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.249625 Jun 07 15:59:08.507525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 24/36] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Jun 7 15:59:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 15:59:08.525217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9bb62157-e161-41d4-9bee-0888833d4f66 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Action: 'create', calling method: .version_select at 0x7f1448954820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-37901704", "metadata": {"Type": "work"}}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9bb62157-e161-41d4-9bee-0888833d4f66 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 117 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.527537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-37901704", "metadata": {"Type": "work"}}} Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.528879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-37901704', 'metadata': {'Type': 'work'}}}} Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise error Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi '' Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.529639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 15:59:08.530932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 15:59:08.532134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 15:59:08.532134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.537637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9bb62157-e161-41d4-9bee-0888833d4f66 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.549521 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9bb62157-e161-41d4-9bee-0888833d4f66 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023485 Jun 07 15:59:08.558044 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 25/37] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 7 15:59:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 15:59:08.574973 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-861b5b02-d9e8-47f6-aa9d-57cd4012ae10 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Calling method '.version_select at 0x7f1448954f70>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:08.675527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-861b5b02-d9e8-47f6-aa9d-57cd4012ae10 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] HTTP exception thrown: Volume tempest-invalid-398387405 could not be found. Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-861b5b02-d9e8-47f6-aa9d-57cd4012ae10 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-398387405 HTTP/1.1 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.679448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Volume tempest-invalid-398387405 could not be found. Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'tempest-invalid-398387405'} Jun 07 15:59:08.680762 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-398387405 could not be found. (HTTP 404) (Request-ID: req-51467336-f32b-4e5a-bdae-a5571acbd67a) Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.681490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 15:59:08.688580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-398387405 could not be found. Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:08.690233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-398387405 could not be found. Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-398387405 could not be found. Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-861b5b02-d9e8-47f6-aa9d-57cd4012ae10 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 404 to user: Volume tempest-invalid-398387405 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-861b5b02-d9e8-47f6-aa9d-57cd4012ae10 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-398387405" status: 404 len: 98 microversion: 2.1 time: 0.114656 Jun 07 15:59:08.691198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 26/38] 10.222.0.18 () {58 vars in 1214 bytes} [Tue Jun 7 15:59:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-398387405 => generated 98 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 15:59:08.700165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2fe1c731-3b7a-4d9d-83f0-8c959637dfbd tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004859 Jun 07 15:59:08.700165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 27/39] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Jun 7 15:59:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 15:59:08.706387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f55cc437-7a6d-42ce-8033-84e01fbb5e14 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004144 Jun 07 15:59:08.719059 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 28/40] 10.222.0.18 () {58 vars in 1136 bytes} [Tue Jun 7 15:59:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 15:59:08.724497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a3a7135b-3e78-453d-8f0b-0099801e30e3 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Calling method '.version_select at 0x7f1448957790>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:08.794496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-a3a7135b-3e78-453d-8f0b-0099801e30e3 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] HTTP exception thrown: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a3a7135b-3e78-453d-8f0b-0099801e30e3 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/os-volumes/eb1f3ca1-be84-450e-9bbd-246379ffb163 HTTP/1.1 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.797584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'eb1f3ca1-be84-450e-9bbd-246379ffb163'} Jun 07 15:59:08.798897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. (HTTP 404) (Request-ID: req-0b4548a2-f97a-430d-b912-4b8d601745ed) Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.799581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 15:59:08.800509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 15:59:08.801503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. Jun 07 15:59:08.802528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.803985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a3a7135b-3e78-453d-8f0b-0099801e30e3 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 404 to user: Volume eb1f3ca1-be84-450e-9bbd-246379ffb163 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.805019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a3a7135b-3e78-453d-8f0b-0099801e30e3 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/eb1f3ca1-be84-450e-9bbd-246379ffb163" status: 404 len: 109 microversion: 2.1 time: 0.084655 Jun 07 15:59:08.805740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 29/41] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 15:59:08 2022] DELETE /compute/v2.1/os-volumes/eb1f3ca1-be84-450e-9bbd-246379ffb163 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:08.815425 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-674cecdc-3b96-444a-8817-b2caa3508d93 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Calling method '.version_select at 0x7f1448954d30>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:08.881584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-674cecdc-3b96-444a-8817-b2caa3508d93 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] HTTP exception thrown: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-674cecdc-3b96-444a-8817-b2caa3508d93 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Request method failure captured: Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/os-volumes/580af185-83c4-4712-b69a-40c23310b907 HTTP/1.1 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XKOpkFQacC5227Qq37TjJ681ksn4sRIkc9oJIT4GfTJ92IqM6YNYidDemxgND2CmC9vSFeI5J4Hp9wD0ZifJwFtUxgtxAvVC4mMbAMlsDL4XCnvCfKwIKRUYNjFgINzDUujvOTTZvoDmBQlCakCxRz_LADMKrMG6yI0dz7MBQe0_0 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:08.883714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70cfc2241ce949a4b18e29d6236d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70cfc2241ce949a4b18e29d6236d9ace", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 70cfc2241ce949a4b18e29d6236d9ace Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-601248463 Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f38eea951904451b88917360ab06c839 Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-601248463-project Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '580af185-83c4-4712-b69a-40c23310b907'} Jun 07 15:59:08.884959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. (HTTP 404) (Request-ID: req-19e021b4-b4d0-4347-b6a4-cf65f9b0acf2) Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.885678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 15:59:08.886743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 15:59:08.887720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. Jun 07 15:59:08.888813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:08.890600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-674cecdc-3b96-444a-8817-b2caa3508d93 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] Returning 404 to user: Volume 580af185-83c4-4712-b69a-40c23310b907 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:08.891610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-674cecdc-3b96-444a-8817-b2caa3508d93 tempest-VolumesNegativeTest-601248463 tempest-VolumesNegativeTest-601248463-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/580af185-83c4-4712-b69a-40c23310b907" status: 404 len: 109 microversion: 2.1 time: 0.080655 Jun 07 15:59:08.893224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 30/42] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 15:59:08 2022] GET /compute/v2.1/os-volumes/580af185-83c4-4712-b69a-40c23310b907 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:08.930129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:08.933881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:08.949633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:08.953537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:08.954617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:08.958184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:09.470903 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:09.484337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-49ebdb8d-e8b9-4b87-b846-3d6de5aeab32 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.589754 Jun 07 15:59:09.484991 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 31/43] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:08 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:09.672930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 15:59:09.673418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 15:59:09.675185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 15:59:09.675692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 15:59:09.676174 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 15:59:09.694385 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:09.697276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:09.699297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:09.707645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:09.770880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:59:09.782901 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for user 8348af929ea740f3981631020a219f80 and project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:59:09.826691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 15:59:09.830776 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 15:59:09.999902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-623a217b-e1d9-4f53-bbee-e76daad9e05c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.961559 Jun 07 15:59:10.003379 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 13/44] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 15:59:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 3971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 15:59:10.022569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8c098612-cd6b-4bdb-abcf-77c703f27ae9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:10.024035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8c098612-cd6b-4bdb-abcf-77c703f27ae9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:10.255030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8c098612-cd6b-4bdb-abcf-77c703f27ae9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:10.269962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8c098612-cd6b-4bdb-abcf-77c703f27ae9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1236 microversion: 2.1 time: 0.256860 Jun 07 15:59:10.271196 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 32/45] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:10 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1236 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:10.502716 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:10.503533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:10.519872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:10.521867 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:10.524155 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:10.525736 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:11.145873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:11.164342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-fc15673a-6bbc-48eb-930a-3a46ba6e9a0a tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.662841 Jun 07 15:59:11.172702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 14/46] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:10 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:11.293913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9e816690-9ef0-4097-873e-88a41334142c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:11.295174 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9e816690-9ef0-4097-873e-88a41334142c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:11.608209 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9e816690-9ef0-4097-873e-88a41334142c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:11.630705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9e816690-9ef0-4097-873e-88a41334142c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1236 microversion: 2.1 time: 0.341244 Jun 07 15:59:11.634828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 33/47] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:11 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1236 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:12.059286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1084932421", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c78cec0-a2d6-49be-a908-94b7edf4c82d"}], "security_groups": [{"name": "tempest-securitygroup--566573353"}], "key_name": "tempest-keypair-1240648331", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:12.070595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:12.194729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:12.195372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:12.208299 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:12.209365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:12.210323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:12.211261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:12.481722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] validate_networks() for [('5c78cec0-a2d6-49be-a908-94b7edf4c82d', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 15:59:12.790364 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:12.800839 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d44efdc3-36b5-4200-a1fc-35646670a392 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.617574 Jun 07 15:59:12.825258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 34/48] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:12 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:12.847701 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:12.849574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:12.883249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:12.886039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:12.887374 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:12.890630 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:13.029798 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:13.040684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7722a2a5-ff2a-4c1f-a730-1f64e6edb4c9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1232 microversion: 2.1 time: 0.212004 Jun 07 15:59:13.053670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 35/49] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:12 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1232 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:13.391301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-72935969", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bca6588e-929f-4019-b79c-d0c7387dc8b6"}], "security_groups": [{"name": "tempest-securitygroup--1469114999"}], "key_name": "tempest-keypair-1520162459", "user_data": "}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:13.678860 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 15:59:13.679315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 15:59:13.679745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 15:59:13.680549 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 15:59:13.681191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 15:59:13.683187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:13.696081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:13.696829 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:13.697031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] validate_networks() for [('bca6588e-929f-4019-b79c-d0c7387dc8b6', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 15:59:13.698061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:13.698697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:13.707481 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=47 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:13.725692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:59:13.741193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:59:13.758720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 15:59:13.761703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 15:59:13.870419 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ecc6b4c5-23da-4da2-a176-7dda33bbc3f4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.811308 Jun 07 15:59:13.875767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 15/50] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 15:59:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 15:59:13.886511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:13.894046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:13.904746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:13.905405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:13.906342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:13.906932 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:14.223216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:14.245200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3485a1f1-04cf-4683-9ae8-82b89b1d46c0 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.365007 Jun 07 15:59:14.248798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 16/51] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:13 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:14.259326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6ecd28b9-efdc-430f-930e-b6e0464f8f43 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:14.260183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6ecd28b9-efdc-430f-930e-b6e0464f8f43 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:14.443581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6ecd28b9-efdc-430f-930e-b6e0464f8f43 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:14.452631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6ecd28b9-efdc-430f-930e-b6e0464f8f43 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1242 microversion: 2.1 time: 0.202677 Jun 07 15:59:14.455158 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 17/52] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:14 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:14.467950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:14.477662 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:14.495711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:14.497356 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:14.498936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:14.500573 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:14.751065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:14.765119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a56f1a69-78c7-4112-844a-e700cbbefbec tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1232 microversion: 2.1 time: 0.307383 Jun 07 15:59:14.768442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 18/53] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:14 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1232 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:15.073123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 15:59:15.073647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 15:59:15.074296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 15:59:15.075359 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 15:59:15.076112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 15:59:15.097780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.098339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.099854 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.103129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.185650 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for project d9f6ff4cee09476c925730a31d32e56f. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 15:59:15.201192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for user 213a7f6737504f9eb89a2e51ddd639ff and project d9f6ff4cee09476c925730a31d32e56f. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 15:59:15.232664 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 15:59:15.242167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 15:59:15.265648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:15.266742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:15.279445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.279968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.280698 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.281131 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.364210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-78e90bad-3702-4b54-806b-b16fddf31498 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.977880 Jun 07 15:59:15.365620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 36/54] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Jun 7 15:59:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 15:59:15.380814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:15.383678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:15.506686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.518871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.524751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.528179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0a59c114-b0ce-476a-824b-43548bca2884 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1280 microversion: 2.20 time: 0.155020 Jun 07 15:59:15.530509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 37/55] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:15 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:15.539873 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:15.544220 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:15.552813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.554325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.557057 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.562287 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.562920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.565126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6dfc4acd-7b3e-40be-97ec-9999b928d38c tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.302859 Jun 07 15:59:15.579436 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 19/56] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:15 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:15.685896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.694947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6026add2-c4d5-49d5-aff1-9ff70513b476 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1246 microversion: 2.1 time: 0.163221 Jun 07 15:59:15.695546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 38/57] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:15 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1246 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:15.785921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:15.786910 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:15.794578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.795048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.795888 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:15.796498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:15.882130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:15.898078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2b727a9f-ed9a-433d-b661-431e869a5a36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1288 microversion: 2.1 time: 0.118613 Jun 07 15:59:15.899224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 20/58] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:15 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:16.547152 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:16.549064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:16.551783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:16.560221 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.560632 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:16.566058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.570719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:16.576218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=55 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:16.586748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:16.587711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:16.604486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.604486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:16.604486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.604486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:16.739219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:16.750511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:16.758967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:16.758967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2e4c7941-1181-4906-98b1-505e290271c2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1284 microversion: 2.20 time: 0.211702 Jun 07 15:59:16.758967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 39/59] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:16 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:16.762603 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:16.763464 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:16.771292 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.771825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:16.773053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:16.773817 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:17.044746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.055837 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2adb363b-34bd-4f14-908e-24a45319583c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1238 microversion: 2.1 time: 0.297600 Jun 07 15:59:17.056455 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 40/60] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:16 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1238 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:17.061130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:17.061737 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:17.070972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:17.071921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:17.072895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:17.073552 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:17.173001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.181956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e378c4ec-83f0-49a7-ad8e-240bc3edfe72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1288 microversion: 2.1 time: 0.124465 Jun 07 15:59:17.182686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 41/61] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:17 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:17.226370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.238199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6410136f-ae7d-4fa2-ab96-08e9e78be846 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.656099 Jun 07 15:59:17.238814 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 21/62] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:16 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:17.777876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:17.778463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:17.786897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:17.787610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:17.789814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:17.790459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:17.877101 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.886099 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.887610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:17.888928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-64a5ed10-b1e7-4cea-b7f6-b7e968d4ea67 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1284 microversion: 2.20 time: 0.117971 Jun 07 15:59:17.889489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 42/63] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:17 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:18.072890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:18.073777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:18.086423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.087281 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.088263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.088955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.199406 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:18.200023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:18.217009 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.217642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.218796 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.219292 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.292027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:18.307015 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5d050c2a-dabe-428a-8d59-2d869ffc0e70 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1238 microversion: 2.1 time: 0.238161 Jun 07 15:59:18.308176 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 22/64] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:18 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1238 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:18.315194 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:18.316120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:18.329993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.330640 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.336976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.337612 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.493456 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:18.525476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c728b0af-a3a2-4f48-ab84-01bbc5bccd7f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1296 microversion: 2.1 time: 0.330071 Jun 07 15:59:18.527441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 43/65] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:18 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1296 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:18.903054 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:18.911969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6e530271-c23a-47be-be00-9f71011286fa tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.602585 Jun 07 15:59:18.913492 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:18.914595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 23/66] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:18 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:18.914788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:18.932667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.933195 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:18.933989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:18.934597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.156706 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:19.184867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:19.193705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:19.198135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ca4457a9-1a71-4126-9560-f79d6ff285a0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1332 microversion: 2.20 time: 0.293655 Jun 07 15:59:19.213198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 44/67] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:18 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1332 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:19.304703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-f3e608eb-308a-4128-98d8-278663dd32d0 req-df31046d-b360-483a-bef2-2921bb79efbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747e9c67-3bd7-4102-81a0-0e8b2ce5c396", "name": "network-vif-plugged", "status": "completed", "tag": "d96ef361-1667-48d9-adb9-586d22a99c8e"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:19.322840 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-f3e608eb-308a-4128-98d8-278663dd32d0 req-df31046d-b360-483a-bef2-2921bb79efbd service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.324502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-f3e608eb-308a-4128-98d8-278663dd32d0 req-df31046d-b360-483a-bef2-2921bb79efbd service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.325725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:19.326602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:19.343893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.346908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.347873 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.348948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.350164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-f3e608eb-308a-4128-98d8-278663dd32d0 req-df31046d-b360-483a-bef2-2921bb79efbd service nova] Creating event network-vif-plugged:d96ef361-1667-48d9-adb9-586d22a99c8e for instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 on hv-cinder-84487 Jun 07 15:59:19.350957 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-f3e608eb-308a-4128-98d8-278663dd32d0 req-df31046d-b360-483a-bef2-2921bb79efbd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 15:59:19.354332 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.355122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.356122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.356777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.370983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.compute.rpcapi [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 15:59:19.372615 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] Releasing lock "compute-rpcapi-router" {{(pid=117819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 15:59:19.409341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0e2ee3b6-bcb2-42d7-a618-0ed689f265cc None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.445043 Jun 07 15:59:19.410006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 24/68] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:19.540719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:19.545903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:19.546657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:19.554523 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-59b97a6d-e9a3-457d-b06d-fd61153b7dbf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1312 microversion: 2.1 time: 0.233182 Jun 07 15:59:19.566944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 45/69] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:19 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:19.567935 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.568587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.569420 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.572235 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.771811 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:19.784945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-03ad68f5-18d2-498f-9875-317b8dab6e82 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1294 microversion: 2.1 time: 0.245011 Jun 07 15:59:19.786188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 25/70] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:19 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1294 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:19.931422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:19.932150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:19.943669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.945311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:19.949881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:19.950423 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.246267 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:20.247565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:20.271417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.273019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.275213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.276413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.656499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:20.673527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:20.676944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:20.681108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-82d8da40-8980-450d-aeb2-f867017ff174 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1338 microversion: 2.20 time: 0.466870 Jun 07 15:59:20.683713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 26/71] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:20 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1338 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:20.695688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:20.701421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:20.704394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:20.721772 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-876c2e8e-0905-474c-ace5-0420264df3a3 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.794856 Jun 07 15:59:20.725522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.725980 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.726802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.728660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.731600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 46/72] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:19 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:20.802436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:20.804189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:20.824017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.824595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.825493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:20.826001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:20.940462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:20.953918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c61a1e5b-3283-4830-b539-52d47bbf9135 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1300 microversion: 2.1 time: 0.268223 Jun 07 15:59:20.958303 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 27/73] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:20 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:21.004738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:21.020801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-281910b6-b277-4c20-9884-2a421a8dab9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1294 microversion: 2.1 time: 0.222141 Jun 07 15:59:21.035216 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 47/74] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:20 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:21.704606 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:21.706271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:21.719848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.721094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:21.724736 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.725230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:21.741730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:21.742710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:21.754979 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.756546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:21.757698 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.760486 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:21.882705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:21.901245 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:21.903105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:21.904901 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b4bce876-7e0f-4331-b633-3b3c8c43c375 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1338 microversion: 2.20 time: 0.206491 Jun 07 15:59:21.905920 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 28/75] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:21 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1338 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:21.971779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:21.972688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:21.985993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.987070 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:21.988233 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:21.988839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:22.684268 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:22.689289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:22.698976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-fd41bd38-2bbc-4631-9b90-c716e3781608 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.731425 Jun 07 15:59:22.700764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-83f50bad-86c9-4f17-9b5b-0b22d717b4c9 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1314 microversion: 2.1 time: 0.963385 Jun 07 15:59:22.701747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 48/77] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:21 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:22.702836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 29/77] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:21 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:22.707867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:22.712403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:22.727480 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:22.727956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:22.733274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:22.733778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:22.923701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:22.925730 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:22.941672 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:22.942760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:22.945411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:22.945898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:23.585707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:23.598138 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:23.600293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:23.602067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ed8b17f3-b586-41a7-87da-83d31995d287 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.682910 Jun 07 15:59:23.615567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 30/78] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:22 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:23.615711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:23.624742 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4ea15a89-e76a-4953-ac38-e51b7f0abea1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.921085 Jun 07 15:59:23.625662 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 49/79] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:22 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:23.716166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:23.717008 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:23.719042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:23.719770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:23.725111 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:23.728980 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:23.731685 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:23.732807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:23.733772 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:23.736309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:23.739707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:23.741503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:24.419003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:24.428969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cc64f46b-4072-429d-87db-0b0b06b4cdeb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.716321 Jun 07 15:59:24.444785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 31/80] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:23 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:24.495131 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:24.516551 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-50495e69-0241-4bd1-a1a2-2aef0942a17e tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1500 microversion: 2.1 time: 0.801784 Jun 07 15:59:24.528749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 50/81] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:23 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1500 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:24.621710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:24.622318 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:24.624483 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=14 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:24.632821 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:24.633742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:24.634674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:24.635172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:24.645567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:24.646184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:24.667617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:24.668079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:24.669114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:24.675190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:25.157110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:25.290686 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:25.306661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:25.308087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:25.309227 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-716e9eea-1cce-4f6b-9d31-0332c7c1e5b3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.691465 Jun 07 15:59:25.309786 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 32/82] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:24 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:25.325864 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:25.336467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ca0baf66-bb5e-40f3-9449-0781f49f1ac1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.696909 Jun 07 15:59:25.338347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 51/83] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:24 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:25.450063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:25.450699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:25.466594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:25.466594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:25.466594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:25.466594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:25.495481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-715edfe6-daa6-483d-ae3d-bf113d986a3d req-8e28448b-54c6-465f-9454-007f191bef3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bdb18ec-9446-430f-a00e-92e1c847f165", "tag": "4ecb2897-4e5c-4117-b213-8efd5b37c89e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:25.516442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-715edfe6-daa6-483d-ae3d-bf113d986a3d req-8e28448b-54c6-465f-9454-007f191bef3b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:25.516442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-715edfe6-daa6-483d-ae3d-bf113d986a3d req-8e28448b-54c6-465f-9454-007f191bef3b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:25.520490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=20 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:25.530286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-715edfe6-daa6-483d-ae3d-bf113d986a3d req-8e28448b-54c6-465f-9454-007f191bef3b service nova] Creating event network-changed:4ecb2897-4e5c-4117-b213-8efd5b37c89e for instance 7bdb18ec-9446-430f-a00e-92e1c847f165 on hv-cinder-84487 Jun 07 15:59:25.539887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-715edfe6-daa6-483d-ae3d-bf113d986a3d req-8e28448b-54c6-465f-9454-007f191bef3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047894 Jun 07 15:59:25.541071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 52/84] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:25.864207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:25.867605 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:25.874887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bc58e938-10dc-4ffa-962e-97116cdca309 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.432809 Jun 07 15:59:25.878297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 33/85] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:25 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:26.258986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7de999e-8a32-4657-acaf-93ea33c3994a"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:26.260588 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:26.284921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.285422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:26.286431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.286877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:26.327278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:26.327808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:26.337790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.338748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:26.341402 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.347801 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:26.592802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:26.603079 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:26.607142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:26.608895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-17272f19-a731-42f8-a686-5c708cd26477 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.285683 Jun 07 15:59:26.610568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 34/86] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:26 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:26.618456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:26.619327 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:26.627887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.628473 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:26.629523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:26.630278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.017081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:27.026620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2f16dd96-386d-4ae7-b31a-45a6557b0da8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.414079 Jun 07 15:59:27.027746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 35/87] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:26 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:27.033159 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:27.034222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:27.041388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:27.042090 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.043018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:27.043609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.243477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:27.252854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-357d78c0-d388-4bc9-8580-3ba18069a716 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.223376 Jun 07 15:59:27.253442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 36/88] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:27 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:27.581584 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9edf7214-7bd8-479d-8d1b-1b8df84e7a0b", "tag": "4208b596-39fa-4701-8fbb-e471f3af4e3d"}, {"name": "network-changed", "server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:27.598328 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:27.598897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.613262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] Creating event network-changed:4208b596-39fa-4701-8fbb-e471f3af4e3d for instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b on hv-cinder-84487 Jun 07 15:59:27.614029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] Creating event network-changed:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 15:59:27.620342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-d7779b05-0aaf-4459-97c0-26c9fb7c63e4 req-93d6e5b3-4ba4-4ac9-becd-82fe65b8fffa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042691 Jun 07 15:59:27.620905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 37/89] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:27.630130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:27.630825 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:27.637068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:27.637511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.638262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:27.638690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:27.789740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:27.801528 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:27.803045 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:27.804166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-229ceac5-d23c-447c-8d67-6c5ff5ef5119 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.179041 Jun 07 15:59:27.804877 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 38/90] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:27 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:28.046220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:28.047134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:28.061445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.061445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:28.062776 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.063372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:28.284790 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-db00e2c8-a819-4ffb-86ba-f78578b5f3d2 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "POST /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.030365 Jun 07 15:59:28.285838 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 53/91] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 15:59:26 2022] POST /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396/os-volume_attachments => generated 194 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:28.291519 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:28.292441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:28.310926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.311618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:28.312637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.313286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:28.691324 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:28.700279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-227854d1-5e10-40dd-bb1d-ad8aea74480f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.660895 Jun 07 15:59:28.702134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 39/92] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:28 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:28.824965 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:28.825746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:28.837433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.838991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:28.847372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:28.847918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:29.195843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:29.213769 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c9e9e917-55e5-4b99-9d5c-6e9974771794 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.926608 Jun 07 15:59:29.214569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 54/93] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:28 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:29.345100 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:29.357586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:29.360643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:29.362339 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a8bfbc6e-e8cd-42bd-b956-afb72b1fa871 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.541933 Jun 07 15:59:29.363541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 40/94] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:28 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:29.719018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:29.721005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:29.727672 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:29.728502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:29.729738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:29.730386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:29.736769 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:29.918765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:29.929539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6b4bfabf-ef7e-44eb-b648-8f26d6ac48de tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.213765 Jun 07 15:59:29.930271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 55/95] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:29 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:30.230109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:30.230713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:30.232668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:30.238104 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.238547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:30.239301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.239732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:30.375312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:30.383269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:30.384063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:30.385576 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-83ffbdc3-e642-43a9-b6fe-b0ee035a5ccf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.159382 Jun 07 15:59:30.386579 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 41/96] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:30 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:30.394003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.394003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:30.394003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.394003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:30.534134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:30.543352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:30.545063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:30.546214 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-da907c4c-3262-4c8a-a58a-3707231185e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.169848 Jun 07 15:59:30.546774 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 56/97] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:30 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:30.947276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:30.947917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:30.954119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.954844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:30.955668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:30.956112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:31.102472 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:31.111137 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d8c0ae83-e1e1-490d-845e-4e233ba041a8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.167656 Jun 07 15:59:31.111883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 42/98] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:30 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:31.406985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:31.408123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:31.415652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:31.416105 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:31.416908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:31.417350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:31.556396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:31.566003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:31.566508 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-51642808-3d47-42ff-82be-bb8a2e9177ee tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.163351 Jun 07 15:59:31.567268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 57/99] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:31 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:31.567558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:31.573661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:31.574103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:31.574876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:31.575300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:31.732012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:31.740133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:31.741683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:31.742772 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f5890526-3539-4c09-b991-bcb1e4e40035 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.181948 Jun 07 15:59:31.743330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 43/100] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:31 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 15:59:32.128840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:32.129564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:32.136634 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.137168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.137954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.138396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.372776 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:32.381605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e0c48050-3dc3-4ceb-bea3-55b4127b72f2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.257369 Jun 07 15:59:32.382265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 58/101] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:32 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:32.583194 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:32.584010 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:32.590309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.590828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.591602 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.592039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.741788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:32.749585 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-52ec2bf8-60fc-49bc-8c08-89539547ad5e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.170567 Jun 07 15:59:32.759747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 44/102] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:32 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 15:59:32.761487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:32.767827 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:32.769707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.770156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.771149 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:32.771488 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:32.935924 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:32.945449 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:32.947016 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:32.948275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cd21b790-8981-4226-8e2c-07e1f3b743be tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.191641 Jun 07 15:59:32.956599 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 59/103] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:32 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:33.399249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:33.399904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:33.405916 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.406370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:33.407137 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.407878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:33.705918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:33.715074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7517e469-160a-4155-8459-f4e61dbeeb97 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.319618 Jun 07 15:59:33.715899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 45/104] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:33 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:33.768707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:33.769322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:33.776823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.777282 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:33.778052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.778493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:33.969065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:33.970271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:33.977649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.978313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:33.979491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:33.980540 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:34.134260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:34.145153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ed104f93-1ae8-45ac-a0b0-42b9d9b54057 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.381228 Jun 07 15:59:34.145857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 60/105] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:33 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:34.378068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:34.389048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:34.390627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:34.394787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0f3feee9-688b-4c5a-9b2d-df3c9e5555a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.429801 Jun 07 15:59:34.396458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 46/106] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:33 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:34.732103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:34.732752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:34.744037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:34.744868 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:34.746484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:34.747213 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:34.951898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:34.962730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-77a183ff-0f97-472c-9301-5871176693fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.234544 Jun 07 15:59:34.963613 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 61/107] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:34 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:35.169802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:35.170695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:35.178043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.178674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:35.180045 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.180660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:35.391249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:35.400104 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b46a4ac9-2d64-4161-96ac-51dbb109bca3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.235585 Jun 07 15:59:35.400847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 47/108] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:35 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:35.420240 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:35.421416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:35.429053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.429511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:35.430297 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.430734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:35.643993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:35.653767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:35.655757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:35.657115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-798a38d9-701a-4142-898e-ec1f3eed0504 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.245301 Jun 07 15:59:35.658696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 62/109] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:35 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:35.983167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:35.984436 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:35.995043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.995990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:35.997790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:35.998429 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:36.217045 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:36.227538 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0a2e30a8-b202-499a-b6c5-13d125c2a7c1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.250117 Jun 07 15:59:36.228796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 48/110] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:35 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:36.419257 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:36.419884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:36.429095 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:36.429562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:36.430348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:36.434413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:36.676080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:36.676732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:36.677819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:36.684785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:36.685244 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:36.686020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:36.687408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:36.689167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fc608ab2-9366-4af6-805c-9ffcbe016f24 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.273475 Jun 07 15:59:36.700827 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 63/111] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:36 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:37.069451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:37.085364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:37.089001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:37.092125 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-59bfacc3-a59e-4dc6-9ee5-21695f3fbe63 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.420495 Jun 07 15:59:37.095308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 49/112] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:36 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:37.246062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:37.246697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:37.258397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.259401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.262683 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.265326 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.426050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:37.427059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:37.446289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.447021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.448095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.448862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.514170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 15:59:37.541175 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:37.711215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:37.712269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-509dae52-b3e4-4da2-94b6-5dbf1a9e9603 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "DELETE /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 204 len: 0 microversion: 2.1 time: 0.293701 Jun 07 15:59:37.713823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 50/113] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 15:59:37 2022] DELETE /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 15:59:37.726570 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-10cc4d83-3b47-4b93-8953-35d28503ef92 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.485178 Jun 07 15:59:37.728096 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 64/114] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:37 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:37.731883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:37.732964 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:37.736865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:37.740434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.741447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.741956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:37.743291 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.743915 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.757223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.761291 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.763900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:37.765558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:37.988299 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.005230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d08b62eb-fcd4-4d2e-af7f-2662e10b7f19 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.288387 Jun 07 15:59:38.006350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 51/115] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:37 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:38.019264 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-32068134-4d7c-48dc-b728-845576723cb4 req-41e37cef-ce83-4c8a-8087-cf5dbd1ee371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "name": "network-vif-plugged", "status": "completed", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:38.028060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-32068134-4d7c-48dc-b728-845576723cb4 req-41e37cef-ce83-4c8a-8087-cf5dbd1ee371 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:38.028531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-32068134-4d7c-48dc-b728-845576723cb4 req-41e37cef-ce83-4c8a-8087-cf5dbd1ee371 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:38.044461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.057226 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-32068134-4d7c-48dc-b728-845576723cb4 req-41e37cef-ce83-4c8a-8087-cf5dbd1ee371 service nova] Creating event network-vif-plugged:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 15:59:38.061559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-04a56226-d12d-4904-a5ae-0a0343441b96 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1552 microversion: 2.1 time: 0.328374 Jun 07 15:59:38.062133 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 65/116] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:37 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1552 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:38.065060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-32068134-4d7c-48dc-b728-845576723cb4 req-41e37cef-ce83-4c8a-8087-cf5dbd1ee371 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056632 Jun 07 15:59:38.066120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 52/117] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:38.111821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:38.112733 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:38.123113 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:38.124182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:38.127956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:38.128471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:38.353315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.365409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.367787 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.368956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f12aa285-59fc-4f90-82c4-64202327f7b6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.261649 Jun 07 15:59:38.380616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 66/118] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:38 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:38.744388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:38.744960 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:38.747019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:38.763971 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:38.765359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:38.767718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:38.768848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:38.966190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:38.976214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7999f60f-ae2d-4e59-aa59-118c8f40cb0f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.236249 Jun 07 15:59:38.981216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 53/119] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:38 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:39.023995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:39.025351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:39.035187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.036253 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.037901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.038494 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.099066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:39.100241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:39.108427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.108959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.110085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.110752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.687491 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:39.690299 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:39.701302 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-92da250e-7dd2-42c8-aa5f-dc0f0186286e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.681435 Jun 07 15:59:39.702404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 67/120] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:39 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:39.702597 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8258b414-65f3-4213-ad65-e7cc6cb72fa5 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1552 microversion: 2.1 time: 0.609265 Jun 07 15:59:39.712543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 54/121] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:39 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1552 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:39.718362 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:39.718960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:39.727538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.728249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.729111 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:39.729882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:39.997761 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:39.998365 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:40.008143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.010357 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.011774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.013506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.055488 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:40.074631 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:40.080884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:40.083781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a8833829-b9f0-435c-a5d6-9dfb6899f837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.368410 Jun 07 15:59:40.085858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 68/122] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:39 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:40.116893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9edf7214-7bd8-479d-8d1b-1b8df84e7a0b", "name": "network-vif-plugged", "status": "completed", "tag": "4208b596-39fa-4701-8fbb-e471f3af4e3d"}, {"server_uuid": "7bdb18ec-9446-430f-a00e-92e1c847f165", "name": "network-vif-plugged", "status": "completed", "tag": "4ecb2897-4e5c-4117-b213-8efd5b37c89e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:40.157250 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.157968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.197949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] Creating event network-vif-plugged:4208b596-39fa-4701-8fbb-e471f3af4e3d for instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b on hv-cinder-84487 Jun 07 15:59:40.198467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] Creating event network-vif-plugged:4ecb2897-4e5c-4117-b213-8efd5b37c89e for instance 7bdb18ec-9446-430f-a00e-92e1c847f165 on hv-cinder-84487 Jun 07 15:59:40.208898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-1bae7ff3-7c03-4fcc-8c78-bd7c0d6e74f9 req-fabf8dca-ce8a-4c5c-8be5-a18d84789ab3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104185 Jun 07 15:59:40.214120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 69/123] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:40.636974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:40.648396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4abd59ed-4a94-4980-b89b-a60b25bd9e72 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.654112 Jun 07 15:59:40.658063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 55/124] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:39 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:40.728454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:40.729148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:40.730889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:40.731865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:40.752320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.753147 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.753632 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.753968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.754452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.754889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:40.755947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:40.756889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.154577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.167879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.168683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-974ac628-5a2b-4bed-901e-c02c61f1ac1d tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1552 microversion: 2.1 time: 0.450937 Jun 07 15:59:41.169550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 56/125] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:40 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1552 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:41.177715 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:41.178578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:41.181594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7a129815-51c6-4fee-8b8b-959b0dbd1ef7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.458822 Jun 07 15:59:41.187601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 70/126] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:40 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:41.194420 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:41.195076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.196237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:41.197616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.393871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-470df053-8e5b-43d0-8738-e6c2acde473c req-f5bf441a-72d5-45a1-b3ae-2e67d227313f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747e9c67-3bd7-4102-81a0-0e8b2ce5c396", "name": "network-vif-deleted", "tag": "d96ef361-1667-48d9-adb9-586d22a99c8e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:41.410713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-470df053-8e5b-43d0-8738-e6c2acde473c req-f5bf441a-72d5-45a1-b3ae-2e67d227313f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:41.412065 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-470df053-8e5b-43d0-8738-e6c2acde473c req-f5bf441a-72d5-45a1-b3ae-2e67d227313f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.452398 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-470df053-8e5b-43d0-8738-e6c2acde473c req-f5bf441a-72d5-45a1-b3ae-2e67d227313f service nova] Creating event network-vif-deleted:d96ef361-1667-48d9-adb9-586d22a99c8e for instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 on hv-cinder-84487 Jun 07 15:59:41.465303 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-470df053-8e5b-43d0-8738-e6c2acde473c req-f5bf441a-72d5-45a1-b3ae-2e67d227313f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075071 Jun 07 15:59:41.466535 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 71/127] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:41.567340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.578401 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.581135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.582251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-68a1ed7a-8694-4367-8ab1-09deb090fa56 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1406 microversion: 2.20 time: 0.411289 Jun 07 15:59:41.582829 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 57/128] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:41 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:41.667997 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:41.669504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:41.682876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:41.683409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.685328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:41.686855 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:41.839590 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:41.852389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-da3e7c9e-4cd7-4867-bc52-50db494a04fb tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1361 microversion: 2.1 time: 0.190146 Jun 07 15:59:41.861831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 72/129] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:41 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:42.189455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:42.190826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:42.199505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.199734 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.200709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.201315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.207810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:42.211929 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:42.224176 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.240801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.241712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.242160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.255121 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.255293 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=100 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:42.256414 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.257321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lazy-loading 'fault' on Instance uuid 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 15:59:42.359930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:42.375169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e7639f7d-15da-441a-9bec-50af7fff5900 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1350 microversion: 2.1 time: 0.191883 Jun 07 15:59:42.376568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 58/130] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:42 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:42.481882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:42.492290 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f52165a8-96d5-4f9b-9dcc-dc4c2e00846c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1367 microversion: 2.1 time: 0.291159 Jun 07 15:59:42.495007 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 73/131] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:42 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:42.600952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:42.601690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:42.607978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.608753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.609614 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.610905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.778849 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:42.788674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:42.790390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:42.791710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b8b9cfec-53cc-47ee-bd4c-5c5b0ddaeee7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1597 microversion: 2.20 time: 0.194952 Jun 07 15:59:42.792429 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 59/132] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 15:59:42 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1597 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 15:59:42.811503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:42.811987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:42.818890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.819378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.820139 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.820607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.871345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:42.872370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:42.882154 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.883035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.886315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:42.887208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:42.924741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-80c49637-7ff4-44e5-81a8-774b13b754ed tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116761 Jun 07 15:59:42.925749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 74/133] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Jun 7 15:59:42 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 15:59:43.061822 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:43.074959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-23cb0592-8c07-4ead-810d-8608970644c6 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1548 microversion: 2.1 time: 0.208246 Jun 07 15:59:43.078302 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 60/134] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:42 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:43.098669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:43.099442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:43.133970 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.137559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.138619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.140940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.328304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0c97659e-6934-4593-8ced-f5b8079fa213 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235642 Jun 07 15:59:43.329614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 75/135] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 15:59:43 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:43.396515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:43.397183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:43.409667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.410114 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.411953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.412432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.464205 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.464817 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.465368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lazy-loading 'fault' on Instance uuid 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 15:59:43.511844 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:43.512620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:43.540573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.541055 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.543066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:43.545522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:43.583759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd3065e2d444dc6a4057713e738e0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7218a263864d068e82a5845e1fa739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:43.592648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-eb8d7b3b-7c33-4ed8-bd34-756413a8cb7b tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 200 len: 1350 microversion: 2.1 time: 0.204017 Jun 07 15:59:43.604855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 61/136] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:43 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 1350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:43.959824 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 15:59:43.982266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-378033e5-5901-4063-bbcd-4eb3539ddf80 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1556 microversion: 2.1 time: 0.474516 Jun 07 15:59:43.988998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 76/137] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:43 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1556 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 15:59:44.007078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:44.007899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:44.017421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.018435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.019951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.020936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.299634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-325e78c5-1f7b-4f77-8759-3d7e367c99d1 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.298943 Jun 07 15:59:44.305884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 62/138] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 15:59:43 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 15:59:44.613234 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:44.614729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:44.632852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.633652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.635771 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.638084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.678311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] HTTP exception thrown: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Request method failure captured: Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 HTTP/1.1 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3W1PpAgeyZ9xwp-Ws4IvLyOt115adJelVLFPdJ410WpITBDW5K4gELkzkPAvpvPY5r9W0BpmVY93VQkMoV4-qZBZVjCEH4n5rYYdxQr5W8ibHGzWvoSvZp3AcBeLAxKa_kGlz1Uus7DmRof5aVm2SCIFW3qW4i2IwwrZ_cDoBKOChU Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:44.696217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0e7218a263864d068e82a5845e1fa739", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: dfd3065e2d444dc6a4057713e738e0b4 Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.697735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '747e9c67-3bd7-4102-81a0-0e8b2ce5c396'} Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:44.698962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.700310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.702029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Returning 404 to user: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:44.702029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-848a4cf7-802f-4226-9a8f-f8c98d9e23f6 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 404 len: 111 microversion: 2.1 time: 0.091415 Jun 07 15:59:44.702029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 77/139] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:44 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:44.883398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:44.884503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:44.917531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.918960 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.920312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:44.926341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:44.957703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] HTTP exception thrown: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Request method failure captured: Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396/os-volume_attachments HTTP/1.1 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3W1PpAgeyZ9xwp-Ws4IvLyOt115adJelVLFPdJ410WpITBDW5K4gELkzkPAvpvPY5r9W0BpmVY93VQkMoV4-qZBZVjCEH4n5rYYdxQr5W8ibHGzWvoSvZp3AcBeLAxKa_kGlz1Uus7DmRof5aVm2SCIFW3qW4i2IwwrZ_cDoBKOChU Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 15:59:44.970950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0e7218a263864d068e82a5845e1fa739", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: dfd3065e2d444dc6a4057713e738e0b4 Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.972202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'server_id': '747e9c67-3bd7-4102-81a0-0e8b2ce5c396'} Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:44.972903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:44.973926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:44.977567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Returning 404 to user: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:44.979845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9dd3d215-278c-4daf-b4ee-6867f2f4a422 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.100565 Jun 07 15:59:44.987631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 63/140] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 15:59:44 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396/os-volume_attachments => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:45.653822 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-f8ded0a7-2c74-4189-82aa-cac858a9176a req-12aeaac9-5309-46ab-9a83-c87b3fb2c66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bdb18ec-9446-430f-a00e-92e1c847f165", "tag": "4ecb2897-4e5c-4117-b213-8efd5b37c89e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:45.665964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-f8ded0a7-2c74-4189-82aa-cac858a9176a req-12aeaac9-5309-46ab-9a83-c87b3fb2c66d service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:45.667589 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-f8ded0a7-2c74-4189-82aa-cac858a9176a req-12aeaac9-5309-46ab-9a83-c87b3fb2c66d service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:45.681004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-f8ded0a7-2c74-4189-82aa-cac858a9176a req-12aeaac9-5309-46ab-9a83-c87b3fb2c66d service nova] Creating event network-changed:4ecb2897-4e5c-4117-b213-8efd5b37c89e for instance 7bdb18ec-9446-430f-a00e-92e1c847f165 on hv-cinder-84487 Jun 07 15:59:45.686726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-f8ded0a7-2c74-4189-82aa-cac858a9176a req-12aeaac9-5309-46ab-9a83-c87b3fb2c66d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036467 Jun 07 15:59:45.692583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 78/141] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:46.288028 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:46.288684 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:46.294843 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:46.295405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:46.296408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:46.297253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:46.314191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] HTTP exception thrown: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Request method failure captured: Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 HTTP/1.1 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3W1PpAgeyZ9xwp-Ws4IvLyOt115adJelVLFPdJ410WpITBDW5K4gELkzkPAvpvPY5r9W0BpmVY93VQkMoV4-qZBZVjCEH4n5rYYdxQr5W8ibHGzWvoSvZp3AcBeLAxKa_kGlz1Uus7DmRof5aVm2SCIFW3qW4i2IwwrZ_cDoBKOChU Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 15:59:46.317032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0e7218a263864d068e82a5845e1fa739", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: dfd3065e2d444dc6a4057713e738e0b4 Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.318117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '747e9c67-3bd7-4102-81a0-0e8b2ce5c396'} Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:46.318747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.320001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.322750 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Returning 404 to user: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:46.323771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5be6f9f8-0b19-426b-a184-d3d0e7fad83f tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "DELETE /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 404 len: 111 microversion: 2.1 time: 0.040758 Jun 07 15:59:46.324617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 64/142] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 15:59:46 2022] DELETE /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:46.335109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 15:59:46.336892 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] [instance: 747e9c67-3bd7-4102-81a0-0e8b2ce5c396] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 15:59:46.345030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:46.346090 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:46.347805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:46.348563 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:46.379767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] HTTP exception thrown: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Request method failure captured: Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 HTTP/1.1 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3W1PpAgeyZ9xwp-Ws4IvLyOt115adJelVLFPdJ410WpITBDW5K4gELkzkPAvpvPY5r9W0BpmVY93VQkMoV4-qZBZVjCEH4n5rYYdxQr5W8ibHGzWvoSvZp3AcBeLAxKa_kGlz1Uus7DmRof5aVm2SCIFW3qW4i2IwwrZ_cDoBKOChU Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 15:59:46.383351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e7218a263864d068e82a5845e1fa739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0e7218a263864d068e82a5845e1fa739", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 0e7218a263864d068e82a5845e1fa739 Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-DeleteServersTestJSON-463744379 Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: dfd3065e2d444dc6a4057713e738e0b4 Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-DeleteServersTestJSON-463744379-project Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.384564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '747e9c67-3bd7-4102-81a0-0e8b2ce5c396'} Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 15:59:46.385194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. Jun 07 15:59:46.386358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 15:59:46.389534 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] Returning 404 to user: Instance 747e9c67-3bd7-4102-81a0-0e8b2ce5c396 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 15:59:46.391505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b6880602-1016-4173-a9d3-0b62b90e4013 tempest-DeleteServersTestJSON-463744379 tempest-DeleteServersTestJSON-463744379-project] 10.222.0.18 "GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396" status: 404 len: 111 microversion: 2.1 time: 0.062454 Jun 07 15:59:46.393111 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 79/143] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 15:59:46 2022] GET /compute/v2.1/servers/747e9c67-3bd7-4102-81a0-0e8b2ce5c396 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 15:59:46.878378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-4f93f7c6-c524-4941-9192-312a07b7f731 req-8c339c44-8e1e-454d-8388-e4609bf2890b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:46.898995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4f93f7c6-c524-4941-9192-312a07b7f731 req-8c339c44-8e1e-454d-8388-e4609bf2890b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:46.899434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4f93f7c6-c524-4941-9192-312a07b7f731 req-8c339c44-8e1e-454d-8388-e4609bf2890b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:46.943055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-4f93f7c6-c524-4941-9192-312a07b7f731 req-8c339c44-8e1e-454d-8388-e4609bf2890b service nova] Creating event network-changed:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 15:59:46.956058 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-4f93f7c6-c524-4941-9192-312a07b7f731 req-8c339c44-8e1e-454d-8388-e4609bf2890b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199376 Jun 07 15:59:46.957317 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 65/144] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 15:59:49.009946 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-cf61ef2e-e78b-4a8d-8825-8dc8f4b59ec4 req-4081c31f-f714-417b-bca5-b5d6c0d3da65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9edf7214-7bd8-479d-8d1b-1b8df84e7a0b", "tag": "4208b596-39fa-4701-8fbb-e471f3af4e3d"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 15:59:49.018930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=82 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 15:59:49.036437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-cf61ef2e-e78b-4a8d-8825-8dc8f4b59ec4 req-4081c31f-f714-417b-bca5-b5d6c0d3da65 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 15:59:49.038053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-cf61ef2e-e78b-4a8d-8825-8dc8f4b59ec4 req-4081c31f-f714-417b-bca5-b5d6c0d3da65 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 15:59:49.064547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-cf61ef2e-e78b-4a8d-8825-8dc8f4b59ec4 req-4081c31f-f714-417b-bca5-b5d6c0d3da65 service nova] Creating event network-changed:4208b596-39fa-4701-8fbb-e471f3af4e3d for instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b on hv-cinder-84487 Jun 07 15:59:49.086419 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-cf61ef2e-e78b-4a8d-8825-8dc8f4b59ec4 req-4081c31f-f714-417b-bca5-b5d6c0d3da65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074940 Jun 07 15:59:49.091433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 80/145] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:01.894218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=29 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:01.894989 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:02.180883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1293073132", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:02.304057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] validate_networks() for [('80297557-5fee-443b-89c5-3ebd07d39a51', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:00:03.562345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:00:03.563578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:00:03.563990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:00:03.564743 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:00:03.565273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:00:03.585814 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:03.587316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:03.589809 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:03.590405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:03.639402 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:03.652227 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for user e9ca987fc23d4ff1a88dd4ed7b38980c and project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:03.682252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:00:03.686820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:00:03.766275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9f0f0ca4-56b8-4806-bc56-1c6a4f6883e9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.877539 Jun 07 16:00:03.767224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 66/146] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:00:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:00:03.775577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:03.776739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=27 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:03.786349 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cd6556db-459d-4d29-895d-37d631532feb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:03.787127 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cd6556db-459d-4d29-895d-37d631532feb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:03.972402 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cd6556db-459d-4d29-895d-37d631532feb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:03.997964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cd6556db-459d-4d29-895d-37d631532feb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1222 microversion: 2.1 time: 0.222320 Jun 07 16:00:04.005000 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 81/147] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:03 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1222 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:04.220692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-98706658", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:04.287807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] validate_networks() for [('80297557-5fee-443b-89c5-3ebd07d39a51', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:00:05.206146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:00:05.206687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:00:05.207057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:00:05.207459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:00:05.208373 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:00:05.220518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:05.220991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:05.221785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:05.222216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:05.243556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:05.248939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for user e9ca987fc23d4ff1a88dd4ed7b38980c and project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:05.268343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:00:05.271783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:00:05.336923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a666f7c2-960d-4448-83c4-18388260fe39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.121331 Jun 07 16:00:05.338646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 67/148] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:00:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:00:05.352698 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-caccccb3-4e9f-4056-9a77-3a1d09dd90e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:05.354887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-caccccb3-4e9f-4056-9a77-3a1d09dd90e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:05.450293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-caccccb3-4e9f-4056-9a77-3a1d09dd90e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:05.462124 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-caccccb3-4e9f-4056-9a77-3a1d09dd90e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1220 microversion: 2.1 time: 0.113719 Jun 07 16:00:05.463742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 68/149] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:05 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:05.598920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-121de289-d610-4bbb-b699-b963c34c3f8f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Action: 'create', calling method: .version_select at 0x7f144918dd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1550618767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdkh0b651RQRA5cOIN6k+7ajECePRd7OChzNGvD1eySkQY2hXFM77Ohgmx4KKGBOTFMB0qPEjjOtt4XIfpPlY3sT6r5yuIk+EmfE0ZrkzcEohQrTvxGrxe4f6GFa+61Tw=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:05.639781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-121de289-d610-4bbb-b699-b963c34c3f8f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:05.649431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-121de289-d610-4bbb-b699-b963c34c3f8f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for user c26cd29ec472479a9a36ac9bb1f05580 and project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:05.697757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-121de289-d610-4bbb-b699-b963c34c3f8f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.480754 Jun 07 16:00:05.698369 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 82/150] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:00:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:06.482490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:06.483856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:06.494346 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:06.505025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:06.508039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:06.510997 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:07.173062 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:07.186258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-752fa3da-c6b0-4153-a4a6-7fda7fba7fd9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1216 microversion: 2.1 time: 0.707952 Jun 07 16:00:07.189531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 69/151] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:06 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1216 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:08.218396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:08.220199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:08.238512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:08.239218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:08.239996 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:08.240839 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:08.424123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:08.432913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-688532f9-178b-4f87-928d-f3a8e1d22efb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1278 microversion: 2.1 time: 0.218260 Jun 07 16:00:08.433512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 83/152] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:08 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:09.449928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:09.451321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:09.464342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:09.464823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:09.465622 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:09.466123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:09.624567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:09.640277 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7165792b-eff4-4afb-9b1d-2ea7f77631ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1278 microversion: 2.1 time: 0.194311 Jun 07 16:00:09.641381 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 70/153] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:09 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:10.664807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:10.668612 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:10.698718 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:10.701679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:10.705828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:10.710159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:11.698990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:11.710447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cff9c536-58b1-4c2d-9ec6-94295e0e87f1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 1.056572 Jun 07 16:00:11.716215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 84/154] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:10 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:12.291917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-9ee50b58-9b7a-4ea1-b21b-b66925bd8f78 req-59ddddea-22e2-4bd4-8d83-deb5e4148b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3def1191-4ee0-45d7-b43f-2e16de89e478", "tag": "4afe8733-9281-4967-aed2-4a9f8c20246a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:12.331363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-9ee50b58-9b7a-4ea1-b21b-b66925bd8f78 req-59ddddea-22e2-4bd4-8d83-deb5e4148b07 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:12.335752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-9ee50b58-9b7a-4ea1-b21b-b66925bd8f78 req-59ddddea-22e2-4bd4-8d83-deb5e4148b07 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:12.386437 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-9ee50b58-9b7a-4ea1-b21b-b66925bd8f78 req-59ddddea-22e2-4bd4-8d83-deb5e4148b07 service nova] Creating event network-changed:4afe8733-9281-4967-aed2-4a9f8c20246a for instance 3def1191-4ee0-45d7-b43f-2e16de89e478 on hv-cinder-84487 Jun 07 16:00:12.403672 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-9ee50b58-9b7a-4ea1-b21b-b66925bd8f78 req-59ddddea-22e2-4bd4-8d83-deb5e4148b07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118891 Jun 07 16:00:12.424462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 71/155] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:00:12.730788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:12.732792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:12.744521 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:12.744986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:12.745777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:12.746215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:13.166625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:13.181917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-487a0bcd-6f02-43ab-bdc6-e58e13e2a3ef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.455293 Jun 07 16:00:13.185636 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 85/156] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:12 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:14.201849 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:14.202567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:14.220085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:14.220571 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:14.221358 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:14.221796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:14.441013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-c5756d33-fbd4-4b45-ac2a-2de256a4fcea req-f9044359-0ea5-4e9a-ad0f-b7e90b75fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d02281-8404-4d09-82b2-ab23ab0623d1", "tag": "450a9373-1070-42c3-866b-57c165da319e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:14.456681 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c5756d33-fbd4-4b45-ac2a-2de256a4fcea req-f9044359-0ea5-4e9a-ad0f-b7e90b75fe16 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:14.457716 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c5756d33-fbd4-4b45-ac2a-2de256a4fcea req-f9044359-0ea5-4e9a-ad0f-b7e90b75fe16 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:14.488149 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-c5756d33-fbd4-4b45-ac2a-2de256a4fcea req-f9044359-0ea5-4e9a-ad0f-b7e90b75fe16 service nova] Creating event network-changed:450a9373-1070-42c3-866b-57c165da319e for instance d9d02281-8404-4d09-82b2-ab23ab0623d1 on hv-cinder-84487 Jun 07 16:00:14.505583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-c5756d33-fbd4-4b45-ac2a-2de256a4fcea req-f9044359-0ea5-4e9a-ad0f-b7e90b75fe16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068712 Jun 07 16:00:14.506197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 86/157] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:00:14.534419 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:14.542921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e2aa749d-32ad-493e-a194-a10591e4fbf3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.345438 Jun 07 16:00:14.550071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 72/158] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:14 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:15.561730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:15.562468 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:15.576218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:15.577080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:15.577907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:15.578525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:15.662295 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:16.147022 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:16.156301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2cc46e30-1c3b-47d4-affb-80e5f2001d6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.598466 Jun 07 16:00:16.157516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 87/159] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:15 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:17.174738 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:17.175402 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:17.178469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=4 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:17.179260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=14 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:17.184019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:17.184492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:17.185263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:17.185699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:17.372247 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:17.382706 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c24c2656-9358-42a1-a92a-cffea2b49d56 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.212609 Jun 07 16:00:17.387438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 73/160] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:17 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:18.399804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:18.400338 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:18.407672 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:18.408470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:18.409334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:18.409978 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:18.577191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:18.594064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7741fdc9-a916-482a-9643-129cf1040ab9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.197880 Jun 07 16:00:18.607335 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 88/161] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:18 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:19.616388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:19.617777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:19.630788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:19.631692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:19.632628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:19.633774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:19.840774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:19.850595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-79e07115-ce79-412d-b38c-d48200d66633 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.239561 Jun 07 16:00:19.851821 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 74/162] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:19 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:20.868586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:20.870586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:20.887450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:20.888156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:20.889132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:20.889730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:20.931284 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-ad7b307b-cf61-4ba4-8c56-7d76d118f44e req-3ace8a8b-2986-4aaf-93de-fe5142eb8c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3def1191-4ee0-45d7-b43f-2e16de89e478", "name": "network-vif-plugged", "status": "completed", "tag": "4afe8733-9281-4967-aed2-4a9f8c20246a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:20.945773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-ad7b307b-cf61-4ba4-8c56-7d76d118f44e req-3ace8a8b-2986-4aaf-93de-fe5142eb8c9b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:20.946259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-ad7b307b-cf61-4ba4-8c56-7d76d118f44e req-3ace8a8b-2986-4aaf-93de-fe5142eb8c9b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:20.977458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-ad7b307b-cf61-4ba4-8c56-7d76d118f44e req-3ace8a8b-2986-4aaf-93de-fe5142eb8c9b service nova] Creating event network-vif-plugged:4afe8733-9281-4967-aed2-4a9f8c20246a for instance 3def1191-4ee0-45d7-b43f-2e16de89e478 on hv-cinder-84487 Jun 07 16:00:20.983239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-ad7b307b-cf61-4ba4-8c56-7d76d118f44e req-3ace8a8b-2986-4aaf-93de-fe5142eb8c9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063388 Jun 07 16:00:20.985259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 75/163] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:21.174793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:21.192297 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2b3542f2-ff5f-4efa-9e21-48f40d6e7db7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.323199 Jun 07 16:00:21.193824 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 89/164] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:20 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:21.570043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0fa6d489-7ddb-4b3a-9bed-f38413ac4a47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Action: 'create', calling method: .version_select at 0x7f14486bfee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-216541568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG22C0gUYuA7Vlj6hNm97+Z7TvSCo+PedaeByiR5ViBJhtGTVQpfNGzEkKscLc16cYDqeiEYE1Ycj9tiA/InIPaV9ktbZOTZhgza94ljlyufBcRP2r9u/hRtQtY+VuiX2Q=="}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:21.592313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-0fa6d489-7ddb-4b3a-9bed-f38413ac4a47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Getting quotas for project 8bc2a18d64e440eabb0f4f4a072cf671. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:21.602221 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-0fa6d489-7ddb-4b3a-9bed-f38413ac4a47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Getting quotas for user 5c98ae10605b4af1b367a28870919e47 and project 8bc2a18d64e440eabb0f4f4a072cf671. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:21.631613 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0fa6d489-7ddb-4b3a-9bed-f38413ac4a47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.325723 Jun 07 16:00:21.632267 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 76/165] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:00:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:22.210984 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:22.211593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:22.222186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:22.222643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:22.223413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:22.223848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:22.423119 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:22.437285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-139986d4-6ba8-405f-9f3e-01a58e1b091c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.229791 Jun 07 16:00:22.443122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 90/166] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:22 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:23.459474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:23.460982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:23.468970 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:23.469780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:23.470571 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:23.471467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:23.627609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:23.635282 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-019b2c72-26f4-47d0-9718-fd58cf47873c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.180059 Jun 07 16:00:23.636092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 77/167] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:23 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:24.168500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-27658dec-68bb-4cd4-8445-9c3caa0456e0 req-af76ddbb-7082-4ea2-9c2b-7695c6f24a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d02281-8404-4d09-82b2-ab23ab0623d1", "name": "network-vif-plugged", "status": "completed", "tag": "450a9373-1070-42c3-866b-57c165da319e"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:24.177773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-27658dec-68bb-4cd4-8445-9c3caa0456e0 req-af76ddbb-7082-4ea2-9c2b-7695c6f24a63 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:24.178156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-27658dec-68bb-4cd4-8445-9c3caa0456e0 req-af76ddbb-7082-4ea2-9c2b-7695c6f24a63 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:24.190030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-27658dec-68bb-4cd4-8445-9c3caa0456e0 req-af76ddbb-7082-4ea2-9c2b-7695c6f24a63 service nova] Creating event network-vif-plugged:450a9373-1070-42c3-866b-57c165da319e for instance d9d02281-8404-4d09-82b2-ab23ab0623d1 on hv-cinder-84487 Jun 07 16:00:24.195574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-27658dec-68bb-4cd4-8445-9c3caa0456e0 req-af76ddbb-7082-4ea2-9c2b-7695c6f24a63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030704 Jun 07 16:00:24.196684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 91/168] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:24.654209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:24.654936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:24.662211 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:24.662656 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:24.663617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:24.664059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:24.817522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:24.825627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-05f1ab6e-d8f5-4310-b333-15dd4e89366e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.176022 Jun 07 16:00:24.826408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 78/169] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:24 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:25.843470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:25.844180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:25.853219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:25.853219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:25.853219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:25.853219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:26.038879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:26.047429 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-72d3b819-f338-45c4-81aa-fa3e6561db72 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1320 microversion: 2.1 time: 0.208848 Jun 07 16:00:26.057319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 92/170] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:25 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:27.065644 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:27.066272 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:27.074447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.075164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.075934 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.076392 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.241628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:27.250327 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8d28d2d7-71e2-477d-afbd-4c4c894dca7b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1514 microversion: 2.1 time: 0.190081 Jun 07 16:00:27.251255 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 79/171] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:27 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:27.267721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:27.271505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:27.277937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.278387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.279189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.279627 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.304379 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'flavor' on Instance uuid d9d02281-8404-4d09-82b2-ab23ab0623d1 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:00:27.433083 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e3265abf-2786-4bb8-87c1-3b7c3d79f750 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1/action" status: 200 len: 32 microversion: 2.1 time: 0.169705 Jun 07 16:00:27.433597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 93/172] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:00:27 2022] POST /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:00:27.442725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:27.443356 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:27.450328 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.450949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.451889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:27.452561 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:27.684444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:27.692398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3205ee99-4c95-4f15-a9e6-f5ea3c071108 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.253394 Jun 07 16:00:27.692977 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 80/173] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:27 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:28.711528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:28.712307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:28.718962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:28.719415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:28.720259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:28.720801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:28.873177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:28.881895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-55f816cc-4a12-49cd-897b-267ef8400920 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.176123 Jun 07 16:00:28.883058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 94/174] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:28 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:29.299018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:29.299543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:29.305504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:29.305952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:29.306712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:29.307147 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:29.330024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-be86a091-1029-4f07-9e20-21fde4b5ae29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/ips" status: 200 len: 151 microversion: 2.20 time: 0.035068 Jun 07 16:00:29.330593 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 81/175] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Jun 7 16:00:29 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 16:00:29.899132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:29.900333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:29.908349 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:29.908796 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:29.909582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:29.910041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:30.047320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:30.055062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d58e166f-08e5-4282-a98c-5236ba8aa137 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.159793 Jun 07 16:00:30.055802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 95/176] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:29 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:30.475356 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:30.475877 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:30.482112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:30.482533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:30.483348 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:30.483917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:30.509104 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8cf09928-0788-472b-a349-558affb04c9d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/ips" status: 200 len: 146 microversion: 2.1 time: 0.037511 Jun 07 16:00:30.509688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 82/177] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:00:30 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:31.072193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:31.072825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:31.079309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.081205 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:31.081962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.082418 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:31.212997 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:31.220533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2d60b462-a346-4127-a2c8-e95bf3f3a602 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.152035 Jun 07 16:00:31.221215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 96/178] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:31 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:31.481927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:31.482453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:31.489041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.489594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:31.490362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.490832 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:31.514820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lazy-loading 'flavor' on Instance uuid a6d85f31-64e0-469b-ab5d-bb1534dc3889 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:00:31.612271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=4 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:31.838604 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9e1da987-5312-42ce-876e-cf4ec94bab11 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/action" status: 202 len: 0 microversion: 2.20 time: 0.360796 Jun 07 16:00:31.839884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 83/179] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 7 16:00:31 2022] POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:00:31.849109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:31.849930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:31.857018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.857547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:31.858539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:31.859034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:32.010941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:32.019141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:32.020680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:32.021918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-67da73e7-9849-4b8e-a089-d88afee7ecab tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.178301 Jun 07 16:00:32.022697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 97/180] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:31 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:00:32.161024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1166096140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1550618767", "security_groups": [{"name": "tempest-secgroup-smoke-741234381"}], "block_device_mapping_v2": [{"uuid": "a326c066-9930-449f-92b3-0460a3e7a463", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5da0562-0cd6-4376-86ed-2ba23dbfe827"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:32.169673 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:32.236590 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:32.237381 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:32.243907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:32.244293 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:32.245097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:32.245541 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:32.275909 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] validate_networks() for [('a5da0562-0cd6-4376-86ed-2ba23dbfe827', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:00:32.455332 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:32.459770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:32.464483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-afc3ad96-dcfb-4832-a1e2-b5d344020bfd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.231826 Jun 07 16:00:32.474414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 98/181] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:32 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:32.729445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:00:32.730214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:00:32.730601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:00:32.731001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:00:32.731404 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:00:32.740522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:32.740958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:32.741735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:32.742159 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:32.748649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:32.762910 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:32.766850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for user c26cd29ec472479a9a36ac9bb1f05580 and project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:32.824071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:00:32.826312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a326c066-9930-449f-92b3-0460a3e7a463',volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:00:32.962258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-deff4219-3247-4527-a952-060351458818 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.806131 Jun 07 16:00:32.963065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 84/182] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:00:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:00:32.973618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7a4f071a-443e-4337-86a1-58be235fffeb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:32.974373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7a4f071a-443e-4337-86a1-58be235fffeb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:33.033777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7a4f071a-443e-4337-86a1-58be235fffeb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:33.041370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:33.041867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7a4f071a-443e-4337-86a1-58be235fffeb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1095 microversion: 2.1 time: 0.072790 Jun 07 16:00:33.042444 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 99/183] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:32 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:33.042539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:33.049615 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:33.050139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:33.050975 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:33.051479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:33.190442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:33.198906 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:33.200473 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:33.202048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-328ba77c-76eb-4349-baaa-5734ab3832cf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.164650 Jun 07 16:00:33.202899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 85/184] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:33 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:33.481540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:33.482243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:33.489309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:33.489828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:33.490716 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:33.491191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:33.639981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:33.648414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a0d95759-1536-4b93-859c-1594577a624d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.170950 Jun 07 16:00:33.648996 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 100/185] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:33 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:34.058908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:34.059530 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:34.065682 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.066360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.067201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.067974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.152209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:34.161287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bfef9f28-7dc7-49e9-9e71-661275379308 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1201 microversion: 2.1 time: 0.106040 Jun 07 16:00:34.161871 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 86/186] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:34 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:34.222064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:34.222667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:34.224658 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:34.230579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.231022 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.231947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.232389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.452897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:34.464046 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:34.465747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:34.466928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-54d01c9f-9266-4296-965b-665281475dda tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.249494 Jun 07 16:00:34.467496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 101/187] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:34 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:34.666846 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:34.667471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:34.675234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.675234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.675476 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:34.675843 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:34.855368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:34.864578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6eb8519b-aeb7-4c19-aa54-2639013397d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.201929 Jun 07 16:00:34.865618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 87/188] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:34 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:35.186877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:35.188489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:35.201323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.202126 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:35.202928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.203375 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:35.349988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:35.357860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e710b7d4-a092-4145-8726-152d393a12cd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1278 microversion: 2.1 time: 0.182782 Jun 07 16:00:35.358464 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 102/189] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:35 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:35.486417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:35.487562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:35.493615 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.494086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:35.494823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.495257 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:35.629209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:35.637372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:35.638885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:35.640030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-14195cfa-0797-4c78-a69a-98b5672586b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.157524 Jun 07 16:00:35.640609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 88/190] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:35 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:35.884492 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:35.885012 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:35.891117 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.891566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:35.892308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:35.892764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:36.023842 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:36.031309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6bc7d519-7b87-4b1e-b2c4-4efff8642ccb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.150803 Jun 07 16:00:36.031879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 103/191] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:35 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:36.374893 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:36.375502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:36.382591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:36.383019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:36.383767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:36.384196 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:36.609946 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:36.618026 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c65cba0c-3f54-49e6-96e7-94e887e67fb4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1278 microversion: 2.1 time: 0.246898 Jun 07 16:00:36.618597 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 89/192] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:36 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:36.661891 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:36.664024 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:36.671371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:36.671821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:36.672628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:36.673064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.048951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:37.050833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:37.058345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:37.059045 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.060054 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:37.061547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.084150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:37.088213 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:37.090054 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:37.091937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0c3f9cf6-667d-4771-9130-12555c64b416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.436018 Jun 07 16:00:37.103169 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 104/193] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:36 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:37.326839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:37.338268 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-97d6fffb-8ef9-49f2-aab1-725e4ba3e31e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.293033 Jun 07 16:00:37.339093 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 90/194] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:37 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:37.544806 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-416a3e66-ec49-4fe7-a85a-a4129e9b1e46 req-3ba57c05-5bea-4e08-b82b-e187fcf3b1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e23c26-7004-42f2-a16b-0bc65e4db372", "tag": "b8d3bc5a-d843-4085-b5eb-1e5ac125f708"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:37.559768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-416a3e66-ec49-4fe7-a85a-a4129e9b1e46 req-3ba57c05-5bea-4e08-b82b-e187fcf3b1aa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:37.560653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-416a3e66-ec49-4fe7-a85a-a4129e9b1e46 req-3ba57c05-5bea-4e08-b82b-e187fcf3b1aa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.576911 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-416a3e66-ec49-4fe7-a85a-a4129e9b1e46 req-3ba57c05-5bea-4e08-b82b-e187fcf3b1aa service nova] Creating event network-changed:b8d3bc5a-d843-4085-b5eb-1e5ac125f708 for instance 37e23c26-7004-42f2-a16b-0bc65e4db372 on hv-cinder-84487 Jun 07 16:00:37.582644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-416a3e66-ec49-4fe7-a85a-a4129e9b1e46 req-3ba57c05-5bea-4e08-b82b-e187fcf3b1aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041735 Jun 07 16:00:37.583404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 105/195] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:37.635417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:37.636223 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:37.642591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:37.643565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.644543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:37.645114 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:37.862816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:37.870486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0b6e8b57-bb72-4e1b-a8fe-a685ecf79a47 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1278 microversion: 2.1 time: 0.239491 Jun 07 16:00:37.871063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 91/196] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:37 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:38.113261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:38.113932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:38.120145 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.120711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.121561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.122071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.151838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a5dfce3-35a3-4e23-b5df-f450a5641dbf"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:38.153016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:38.159869 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.160325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.161123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.161562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.367570 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:38.378150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:38.380861 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:38.382392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ecdd5d25-578b-4f87-b7d8-8cd295c93190 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.274990 Jun 07 16:00:38.394329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 106/197] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:38 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:00:38.400144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:38.401019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:38.408252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.409642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.410703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.411498 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.495955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8cfe0947-2b68-4648-b0d4-b1d66f1e35b7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347865 Jun 07 16:00:38.496720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 92/198] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:00:38 2022] POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:00:38.659787 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:38.673158 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5cc8f4a3-2e10-4a12-acc4-27a87c172f33 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.277493 Jun 07 16:00:38.675266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 107/199] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:38 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:38.676231 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:38.677164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:38.696790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.696790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.698051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.700845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.725669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6f5d0113-60b0-4ba1-a81c-cb7069665a4d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/ips" status: 200 len: 149 microversion: 2.1 time: 0.061936 Jun 07 16:00:38.726313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 93/200] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:00:38 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:38.888115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:38.889285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:38.896571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.897033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:38.897805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:38.898248 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:39.059712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:39.068386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6f547b1c-3d5d-4d49-bdc4-14b01b768ec7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.185121 Jun 07 16:00:39.069104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 108/201] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:38 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:39.406976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:39.406976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:39.409086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:39.409532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:39.410856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:39.411293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:39.551750 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:39.559661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:39.561204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:39.562356 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dfb87628-45ed-4e7b-99dc-3421c1909930 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.165089 Jun 07 16:00:39.562912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 94/202] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:39 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:39.693171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:39.694052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:39.701889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:39.702803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:39.704509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:39.704959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:39.838874 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:39.847079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6fc239af-b014-43f0-bb5d-125e62d9e74b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.160102 Jun 07 16:00:39.847643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 109/203] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:39 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:40.079706 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e517e94-2f36-4b7e-a6df-0a8402f165d5"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:40.081506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:40.086017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:40.086625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:40.088174 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.088655 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.089417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.089855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.092574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.093020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.093765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.094197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.238595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:40.247258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bfa3e378-0caa-458c-909c-6ed952ff1c08 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.164857 Jun 07 16:00:40.248132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 110/204] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:40 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:40.347462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5fbb3d90-0d54-4399-bd9c-f55fad9e5543 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271252 Jun 07 16:00:40.348085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 95/205] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:00:40 2022] POST /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:40.581903 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:40.582508 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:40.589702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.590144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.590897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.591329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.719204 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:40.727919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:40.729396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:40.730831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9b179cb1-5a49-4c31-95e6-8e2983e5dfe9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.153349 Jun 07 16:00:40.731387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 111/206] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:40 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:00:40.866208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:40.867097 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:40.873446 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.873896 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:40.874663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:40.875110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:41.010995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:41.019458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4239311e-5a71-4612-b236-a4f22884c175 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.157911 Jun 07 16:00:41.019663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 96/207] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:40 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:41.265063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:41.265596 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:41.272759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:41.273202 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:41.273948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:41.274375 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:41.401770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:41.409536 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3050a1b5-a27d-456a-b37f-e188489ddd02 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.148366 Jun 07 16:00:41.410285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 112/208] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:41 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:41.750099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:41.750706 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:41.757890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:41.758333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:41.759089 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:41.759522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:41.886663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:41.895296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:41.896908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:41.898047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-960a2185-0cc9-4160-89c9-81b242e6b6da tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.151790 Jun 07 16:00:41.898614 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 97/209] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:41 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:42.035890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:42.036553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:42.042851 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.043304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:42.044062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.044546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:42.178193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:42.185609 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b94b15b1-3b92-4860-a2e3-63ce618bd0c1 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.154607 Jun 07 16:00:42.186173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 113/210] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:42 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:42.426389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:42.426988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:42.433647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.434098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:42.434850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.435282 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:42.567418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:42.574818 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d14e8ae5-b779-48a0-906f-936f851d4dc3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.152519 Jun 07 16:00:42.575379 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 98/211] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:42 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:42.917057 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:42.917659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:42.923680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.924124 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:42.924901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:42.925334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:43.039713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:43.055639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:43.063500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:43.065613 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:43.067174 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-895387b6-a39e-40bb-bfd9-41022df1ba98 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.153656 Jun 07 16:00:43.077351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 114/212] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:42 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:43.202345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:43.202872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:43.206837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:43.207547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:43.211959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:43.212429 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:43.213191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:43.213628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:43.216965 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:43.351188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:43.363005 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-009ba8ed-44e1-4be5-bc92-7ce0c658055c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.163480 Jun 07 16:00:43.363894 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 99/213] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:43 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:43.591962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:43.592616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:43.599159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:43.599607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:43.600379 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:43.600822 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:43.731505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:43.740697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d33e3c0c-2b70-4a43-8487-a10683cde2bc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.152452 Jun 07 16:00:43.741295 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 115/214] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:43 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:44.084625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:44.085150 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:44.091626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.092068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.092844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.093275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.228378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:44.236663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:44.238722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:44.239905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-63a4ebce-ef2a-4794-9abe-8927d4cdea3f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.159748 Jun 07 16:00:44.240480 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 100/215] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:44 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:44.380917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:44.381483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:44.388030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.388511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.389263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.389694 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.525634 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:44.533192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5db4a03a-932e-4fd3-9b5a-c97598d32bb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.156777 Jun 07 16:00:44.534439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 116/216] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:44 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:44.623935 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-763757595", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-216541568", "security_groups": [{"name": "tempest-secgroup-smoke-1623249190"}], "networks": [{"uuid": "b8456bfa-e327-4646-9098-4f04d53b18a5"}], "block_device_mapping_v2": [{"uuid": "2a569259-0370-4685-93ba-fed9dfee0603", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:44.734205 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] validate_networks() for [('b8456bfa-e327-4646-9098-4f04d53b18a5', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:00:44.758004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:44.758617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:44.764742 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.765199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.765966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:44.766409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:44.771002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=100 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:44.972925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:44.980819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f2047909-cc1d-4ded-b85d-7ffbe9e6e5e8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.226602 Jun 07 16:00:44.984403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 117/217] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:44 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:45.173852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:00:45.174963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:00:45.175255 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:00:45.175662 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:00:45.176101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:00:45.185541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.185988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.186808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.187237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.204181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Getting quotas for project 8bc2a18d64e440eabb0f4f4a072cf671. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:45.208161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Getting quotas for user 5c98ae10605b4af1b367a28870919e47 and project 8bc2a18d64e440eabb0f4f4a072cf671. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:45.258757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:45.259370 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:45.265401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.265920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.266689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.266899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:00:45.267331 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.269610 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a569259-0370-4685-93ba-fed9dfee0603',volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:00:45.415514 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f87c8068-2d19-40a8-a250-c05b80499e9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795246 Jun 07 16:00:45.416447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 101/218] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:00:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:00:45.417889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:45.426508 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7234e8f0-9494-4485-a6c7-13025e06b5a8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:45.427126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7234e8f0-9494-4485-a6c7-13025e06b5a8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:45.427434 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:45.429108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:45.430353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2d111b2e-b987-447f-a6e4-f928c45dd234 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.175537 Jun 07 16:00:45.440872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 118/219] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:45 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:00:45.481534 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7234e8f0-9494-4485-a6c7-13025e06b5a8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:45.489817 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7234e8f0-9494-4485-a6c7-13025e06b5a8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1087 microversion: 2.1 time: 0.067430 Jun 07 16:00:45.490482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 102/220] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:45 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:45.549595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:45.550224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:45.558714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.559179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.560274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:45.560741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:45.753300 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:45.761448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3313c411-af10-42af-8202-8bbed54d986c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.215539 Jun 07 16:00:45.762043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 119/221] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:45 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:45.997532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:45.998135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:46.005482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.005927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.006676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.007109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.169879 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:46.179697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7a930817-22df-4b50-b9ff-b1136922583a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.185874 Jun 07 16:00:46.185302 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 103/222] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:45 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:46.450642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:46.451318 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:46.458310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.458758 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.459519 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.459954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.506198 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:46.506816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:46.513380 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.514013 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.514942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.515536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.609372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:46.618017 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ebfbc468-e586-4ab0-bdac-1de19cf741eb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1185 microversion: 2.1 time: 0.116048 Jun 07 16:00:46.625237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 104/223] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:46 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:46.635289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:46.649003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:46.651838 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:46.653330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7933cbb7-3d49-4ced-9670-93a475de14ec tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.206758 Jun 07 16:00:46.654733 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 120/224] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:46 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:46.779888 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:46.780779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:46.788575 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.789027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:46.789973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:46.790582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.130972 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:47.136268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-17081360-67ed-4c34-8f5e-0f5e4a546e63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:47.140712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-322359d4-80be-47d9-87a2-3d06b336ca98 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.365828 Jun 07 16:00:47.143712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-17081360-67ed-4c34-8f5e-0f5e4a546e63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.144661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-17081360-67ed-4c34-8f5e-0f5e4a546e63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.151569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 105/225] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:46 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:47.197575 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:47.198586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:47.205345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.206188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.207203 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.207855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.223116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-17081360-67ed-4c34-8f5e-0f5e4a546e63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Going to try to stop instance {{(pid=117818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 16:00:47.282705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-17081360-67ed-4c34-8f5e-0f5e4a546e63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action" status: 202 len: 0 microversion: 2.1 time: 0.158911 Jun 07 16:00:47.283269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 121/226] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:00:47 2022] POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 16:00:47.291538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:47.292232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:47.301588 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.302237 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.303993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.304621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.767275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:47.775435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7af0bc93-f33f-43c9-9d60-75d18528f778 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.581542 Jun 07 16:00:47.776279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 106/227] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:47 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:47.781201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:47.781809 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:47.788663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.789199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.790166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.790605 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.812296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:47.820826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c8ab120e-aef8-4903-8280-ce81d763c8c8 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.533229 Jun 07 16:00:47.821413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 122/228] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:47 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:47.833925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:47.834748 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:47.842600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.843216 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.844139 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:47.844700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:47.873969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:47.881890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e462f029-0914-4234-b267-1625ed6c3134 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1203 microversion: 2.1 time: 0.104551 Jun 07 16:00:47.882482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 107/229] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:47 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1203 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:48.074941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:48.083840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:48.085363 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:48.086600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b6afc67e-ce6b-4f44-91c4-7a19dce4508f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.257109 Jun 07 16:00:48.087079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 123/230] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:47 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:48.158336 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:48.159589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:48.166537 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.166986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.167781 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.168220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.345396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:48.354942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1622755f-f85d-406c-828b-4d8434cb6ab4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.200086 Jun 07 16:00:48.355520 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 108/231] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:48 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:48.586321 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-232d6ce3-839c-4855-9b34-f33649a1eaae req-ae916f58-1941-43c6-8235-1e2cc412c730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e23c26-7004-42f2-a16b-0bc65e4db372", "name": "network-vif-plugged", "status": "completed", "tag": "b8d3bc5a-d843-4085-b5eb-1e5ac125f708"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:48.597048 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-232d6ce3-839c-4855-9b34-f33649a1eaae req-ae916f58-1941-43c6-8235-1e2cc412c730 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.597970 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-232d6ce3-839c-4855-9b34-f33649a1eaae req-ae916f58-1941-43c6-8235-1e2cc412c730 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.615007 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-232d6ce3-839c-4855-9b34-f33649a1eaae req-ae916f58-1941-43c6-8235-1e2cc412c730 service nova] Creating event network-vif-plugged:b8d3bc5a-d843-4085-b5eb-1e5ac125f708 for instance 37e23c26-7004-42f2-a16b-0bc65e4db372 on hv-cinder-84487 Jun 07 16:00:48.620030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-232d6ce3-839c-4855-9b34-f33649a1eaae req-ae916f58-1941-43c6-8235-1e2cc412c730 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039895 Jun 07 16:00:48.621388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 124/232] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:48.793667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:48.794373 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:48.802862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.806193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.807142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.807658 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.838437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:48.839868 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:48.848840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.849320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:48.850083 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:48.850517 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.169376 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.177309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-be43ba48-a833-49c8-856d-502bfa078c8d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.388109 Jun 07 16:00:49.177895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 109/233] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:48 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:49.184434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:49.185055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:49.188605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.196837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.197290 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.198234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.198673 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.198788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1e00dd0d-abc8-436c-8391-4fead95e8f1c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.364350 Jun 07 16:00:49.199640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 125/234] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:48 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:49.204918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:49.206372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:49.213355 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.214166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.215878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.216877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.506918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.511744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.516577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-fdee0d0b-3753-4f3f-b908-e435bf2899ae tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1271 microversion: 2.1 time: 0.337413 Jun 07 16:00:49.517350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 110/235] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:49 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:49.520992 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.522541 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.523690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-31f7befd-9840-4de1-8595-8c7a520ed163 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.322826 Jun 07 16:00:49.524414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 126/236] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:49 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:49.531201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:49.531668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:49.538538 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.539071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.539912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.540380 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.651781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-9cf84f78-6764-4e1d-b6c8-f2a2f83918a3 req-a5c11adf-7243-4987-a55e-eaf805fd74d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:49.662309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-9cf84f78-6764-4e1d-b6c8-f2a2f83918a3 req-a5c11adf-7243-4987-a55e-eaf805fd74d8 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:49.662853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-9cf84f78-6764-4e1d-b6c8-f2a2f83918a3 req-a5c11adf-7243-4987-a55e-eaf805fd74d8 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:49.678563 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-9cf84f78-6764-4e1d-b6c8-f2a2f83918a3 req-a5c11adf-7243-4987-a55e-eaf805fd74d8 service nova] Creating event network-changed:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:00:49.685916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-9cf84f78-6764-4e1d-b6c8-f2a2f83918a3 req-a5c11adf-7243-4987-a55e-eaf805fd74d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038355 Jun 07 16:00:49.686716 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 127/237] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:49.738461 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:49.746412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-960741d6-ca1f-4b08-b377-ca6e07515cfc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.218974 Jun 07 16:00:49.747094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 111/238] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:49 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:50.195067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:50.195773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:50.202114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.202568 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.203328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.203765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.217160 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:50.217828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:50.231200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.231939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.232875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.233395 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.488603 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.497160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-acc2f452-e7f8-4eaf-9e29-74cf0a9df16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1266 microversion: 2.1 time: 0.306507 Jun 07 16:00:50.497741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 128/239] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:50 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:50.499556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.508780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c15fbb86-6ab3-4367-b0fa-519c1e1adbc0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.295363 Jun 07 16:00:50.509362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 112/240] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:50 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:50.533907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:50.534540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:50.540970 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.541414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.541866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:50.542160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.542502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:50.542603 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.548652 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.549115 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.549883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.550326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.743098 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.747489 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.750822 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9a639740-5b8f-4798-aee8-655de4755583 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1271 microversion: 2.1 time: 0.220747 Jun 07 16:00:50.751392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 129/241] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:50 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:50.755930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.757490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.758646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-825095b5-e876-4d93-a156-25f52b00c6ac tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.220650 Jun 07 16:00:50.760681 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 113/242] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:50 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:00:50.765277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:50.765887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:50.772730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.773184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.773961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:50.774410 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:50.913191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:50.920646 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6aa844bd-bef8-4ed4-9459-d78697f04745 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.159166 Jun 07 16:00:50.921407 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 130/243] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:50 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:51.514432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:51.515069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:51.522149 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.524146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.524146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.524146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.526101 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:51.526733 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:51.533072 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.533528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.534438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.534908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.735356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:51.739663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:51.744670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1c4c4995-8c8c-4f54-ba8a-128916bc76a9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.222564 Jun 07 16:00:51.745249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 131/244] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:51.747258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2d775d23-5467-4940-a669-aa05f77e7835 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1453 microversion: 2.1 time: 0.236708 Jun 07 16:00:51.747826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 114/245] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1453 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:51.763345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:51.763960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:51.767121 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:51.767722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:51.770652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.771108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.771930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.772426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.774645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.775094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.775845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.776275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.978194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:51.986597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-78d93e83-efc8-4fdd-86fb-6c3958f4bb1f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1453 microversion: 2.1 time: 0.226809 Jun 07 16:00:51.987180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 132/246] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:51.988403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:51.991705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:51.992307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:51.996543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5bab71aa-7d70-4a13-aa80-989fcdde7fe8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1271 microversion: 2.1 time: 0.232982 Jun 07 16:00:51.997304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 115/247] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:51.998108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.998553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:51.999309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:51.999740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:52.003581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:52.004962 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:52.011943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:52.012427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:52.013327 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:52.013761 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:52.211805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:52.215382 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:52.220159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:52.221686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:52.222923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b5e902e3-200c-4ad0-ba79-b8c300e2d882 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.234751 Jun 07 16:00:52.224466 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 133/248] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:52.225169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-50503f98-bc1d-418d-8c4c-0e8ec9021008 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.226525 Jun 07 16:00:52.225921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 116/249] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:51 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:52.761633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:52.762241 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:52.768700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:52.769150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:52.769910 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:52.770494 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:52.774811 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:52.909786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:52.921916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-68144249-2c7b-483d-92cf-17864240e5b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.163997 Jun 07 16:00:52.922664 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 134/250] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:52 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:53.015920 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:53.017574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:53.024929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:53.026972 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.027661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.028855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.029513 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.051779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:53.242784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:53.243400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:53.250382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.250966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.251853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.252294 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.265065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:53.274296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d1eda0db-23b6-40a2-b42d-508b7969ae8e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1271 microversion: 2.1 time: 0.263011 Jun 07 16:00:53.276001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 117/251] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:53 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:53.282264 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:53.283112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:53.291872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.292618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.293596 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.294247 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.522875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:53.530242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:53.538903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-92f405bd-1a0b-48a7-b4ff-df5985dd3e0d tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.260481 Jun 07 16:00:53.539494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 118/252] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:53 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:53.544454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:53.546011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:53.547164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bcb43604-8372-446d-be91-d14ea81257cc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1743 microversion: 2.20 time: 0.309007 Jun 07 16:00:53.547893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 135/253] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:53 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:53.943886 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:53.944620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:53.951307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.952550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:53.953335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:53.953785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.119122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:54.136066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0da37783-9087-4ce3-bd9f-ab2030a0c93b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.199399 Jun 07 16:00:54.136713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 119/254] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:53 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:54.138645 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-69c0d362-880f-4961-920c-a9df1df2a970 req-d151a1cd-5ff5-46c6-915e-c54717a71add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e23c26-7004-42f2-a16b-0bc65e4db372", "tag": "b8d3bc5a-d843-4085-b5eb-1e5ac125f708"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:54.147725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-69c0d362-880f-4961-920c-a9df1df2a970 req-d151a1cd-5ff5-46c6-915e-c54717a71add service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.148166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-69c0d362-880f-4961-920c-a9df1df2a970 req-d151a1cd-5ff5-46c6-915e-c54717a71add service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.159768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-69c0d362-880f-4961-920c-a9df1df2a970 req-d151a1cd-5ff5-46c6-915e-c54717a71add service nova] Creating event network-changed:b8d3bc5a-d843-4085-b5eb-1e5ac125f708 for instance 37e23c26-7004-42f2-a16b-0bc65e4db372 on hv-cinder-84487 Jun 07 16:00:54.165203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-69c0d362-880f-4961-920c-a9df1df2a970 req-d151a1cd-5ff5-46c6-915e-c54717a71add service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030243 Jun 07 16:00:54.165803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 136/255] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:54.292172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:54.293068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:54.300191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.300680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.302194 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.302787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.336036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9f9a0ef2-6594-4b12-9562-9c9e038fea42 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: .version_select at 0x7f14486728b0>, body: {"keypair": {"name": "tempest-keypair-1335057143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQxgIA7yNj4tZ2jGdIQkiQEy0Q7lp2RqhpdcVeongNO6FhSJ9o8MyyKUzX8fs2CxpZUn3Mm09oPDFUwzG2NDAfEzc7rt9J8U55fgC1230T4TSPlo85O2s1+GGfgGxG4Mw=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:54.350691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9f9a0ef2-6594-4b12-9562-9c9e038fea42 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:54.355070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9f9a0ef2-6594-4b12-9562-9c9e038fea42 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:54.393063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9f9a0ef2-6594-4b12-9562-9c9e038fea42 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061103 Jun 07 16:00:54.393850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 137/256] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:00:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:00:54.509923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:54.527404 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-429ff98b-9daa-473a-a6cb-42f7c693e2b9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.239268 Jun 07 16:00:54.530656 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 120/257] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:54 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:54.558185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:54.559350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:54.569207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:54.569886 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:54.578651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.580571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.581710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.583638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.584897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.585349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:54.586120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:54.586555 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:55.018978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.028854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.029120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.030922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.032339 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-427d2aa9-b5a9-40f2-8b51-d4a3003dd353 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1743 microversion: 2.20 time: 0.469999 Jun 07 16:00:55.033904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 121/258] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:54 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1743 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:55.049244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f7b14143-a7f0-481c-b7ab-42c0f5b996b2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.497040 Jun 07 16:00:55.049919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 138/259] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:54 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:55.153662 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:55.154070 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:55.161165 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:55.161552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:55.162584 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:55.163181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:55.206339 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:55.489731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=8 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:55.547741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:55.548384 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:55.557397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:55.558272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:55.559323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:55.559863 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:55.616631 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.625617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a5dcd424-ff43-4c53-9332-9efd5e55a49b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.475908 Jun 07 16:00:55.636569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 122/260] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:55 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:55.732003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:55.740950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6b7608b8-b980-4ed9-9a3c-6702139200ef tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.197397 Jun 07 16:00:55.741538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 139/261] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:55 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:56.055485 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:56.056107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:56.064279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.064930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.065725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.066160 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.067940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:56.068881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:56.075501 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.075951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.076778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.077218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.297694 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:56.299848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:56.306608 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0ba280bd-92dc-4e65-bd28-448de961ceb3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.243168 Jun 07 16:00:56.310209 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 140/262] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:56 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:56.313259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:56.314940 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:56.316105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-01be0f27-5f4b-41f0-853c-2f8f61ec3ed2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1743 microversion: 2.20 time: 0.267755 Jun 07 16:00:56.316731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 123/263] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:56 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:56.327235 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975596709", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c78cec0-a2d6-49be-a908-94b7edf4c82d"}], "security_groups": [{"name": "tempest-securitygroup--1932563553"}], "key_name": "tempest-keypair-1335057143", "user_data": "}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:56.444312 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] validate_networks() for [('5c78cec0-a2d6-49be-a908-94b7edf4c82d', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:00:56.630805 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-2ff48ce9-b453-428d-bb18-d3bfa1ea0217 req-d7bca8fb-4362-439e-8362-323df3e85fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "name": "network-vif-plugged", "status": "completed", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:00:56.646676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2ff48ce9-b453-428d-bb18-d3bfa1ea0217 req-d7bca8fb-4362-439e-8362-323df3e85fa9 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.647469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2ff48ce9-b453-428d-bb18-d3bfa1ea0217 req-d7bca8fb-4362-439e-8362-323df3e85fa9 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.675838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-2ff48ce9-b453-428d-bb18-d3bfa1ea0217 req-d7bca8fb-4362-439e-8362-323df3e85fa9 service nova] Creating event network-vif-plugged:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 16:00:56.683251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-2ff48ce9-b453-428d-bb18-d3bfa1ea0217 req-d7bca8fb-4362-439e-8362-323df3e85fa9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058832 Jun 07 16:00:56.684482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 124/264] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:00:56.689683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:56.691270 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:56.697752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.698433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.699360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.699795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.921173 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:56.930986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5c37b68c-1d0d-4725-b6cc-272917f2a607 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.245176 Jun 07 16:00:56.931854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 125/265] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:56 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:56.940758 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:00:56.942829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:00:56.943507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:00:56.943989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:00:56.944625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:00:56.946079 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:56.946700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:56.952694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.953136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.953883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.954183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.954309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.954791 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.955648 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:56.956151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:56.975463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:00:56.979664 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:00:56.982574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:00:56.994283 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:00:56.996575 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:00:57.063043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4207bd5d-bea7-422c-9bc5-673d8927caf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739756 Jun 07 16:00:57.064279 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 141/266] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:00:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:00:57.074741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4ce890e9-e49b-487b-9a28-5d9571bd644c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:57.075658 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4ce890e9-e49b-487b-9a28-5d9571bd644c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:57.153999 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.157976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4ce890e9-e49b-487b-9a28-5d9571bd644c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.166616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5568a467-262e-459c-b22f-32796d3a4de3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.224301 Jun 07 16:00:57.174138 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4ce890e9-e49b-487b-9a28-5d9571bd644c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1241 microversion: 2.1 time: 0.103493 Jun 07 16:00:57.177760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 126/267] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:56 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:57.188152 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 142/268] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:57 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:57.345541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:57.351887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:57.352809 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:57.353834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:57.363336 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.369070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:57.370609 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.371076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:57.382071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.382744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:57.389531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.406103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:57.602346 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.615440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.622199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.623396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-721ad25e-18c4-49f4-a9b2-6bdd2e54cd9c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.278470 Jun 07 16:00:57.625003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 143/269] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:57 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:57.677875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:57.685902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dd256d36-26c7-4e51-9da3-85c8ac1e41a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.353866 Jun 07 16:00:57.698872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 127/270] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:57 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:57.949533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:57.950767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:57.957929 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.958416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:57.959415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:57.959854 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.104713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:58.114121 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-51b1cd0c-2514-4640-8072-d30d6a17d383 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.168084 Jun 07 16:00:58.115093 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 144/271] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:57 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:58.184412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:58.185613 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:58.191100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:58.192328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:58.192608 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.193295 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.194380 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.195197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.201348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.201714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.202485 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.202912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.309836 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:58.322395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4690e3b7-fa3a-44c1-b2bf-99a26807a58e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1293 microversion: 2.1 time: 0.135244 Jun 07 16:00:58.332420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 145/272] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:58 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:58.385868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:58.394593 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-04d09a88-5e37-4903-a374-0058395f4f3a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.213954 Jun 07 16:00:58.396827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 128/273] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:58 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:58.643420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:58.644660 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:58.658151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.664912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.666009 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.666560 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.708479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:58.709107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:58.720167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.720653 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.721444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:58.721889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:58.987127 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:58.996844 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:58.998796 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:59.000242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ad452a2b-c42c-47d8-9631-711b802e623c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.361154 Jun 07 16:00:59.012289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 146/274] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:00:58 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:00:59.036955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:59.045978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2f355c53-e730-431e-be51-c21be74774a7 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.342620 Jun 07 16:00:59.046988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 129/275] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:58 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:00:59.133580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:59.137277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:59.145773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.148002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.149265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.149921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.349063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:59.351000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:59.358949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.359741 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.361222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.361859 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.404450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:59.415516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fb122d3a-c092-4eb9-874b-b08ac7b804c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.287201 Jun 07 16:00:59.416961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 147/276] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:59 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:59.422576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:00:59.423534 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:00:59.434092 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.434967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.435991 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:00:59.436766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:00:59.507325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:59.518087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e98e99f7-e91b-406c-9239-90745a9f7cb3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1299 microversion: 2.1 time: 0.173070 Jun 07 16:00:59.518939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 130/277] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:59 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:00:59.659354 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:00:59.668594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1e5f6b24-3529-43ce-8716-7d562d632c99 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.250131 Jun 07 16:00:59.669476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 148/278] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:00:59 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:00.019456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:00.021285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:00.027722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.028094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.028926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.029351 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.071727 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:00.081155 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:00.091538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.091990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.092972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.093412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.266256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.279192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.281186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.282823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ad60ace1-8356-4352-b55c-c82c467cc1f2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.267589 Jun 07 16:01:00.283622 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 131/279] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:00 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:00.297627 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.305729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ac81a985-a88e-4fb5-afc6-7090ae8af79b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.238241 Jun 07 16:01:00.306739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 149/280] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:00 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:00.435558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:00.436202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:00.442848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.443235 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.444348 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.444994 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.534868 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:00.536137 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:00.542458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.542985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.543945 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.544325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.581094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.589423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b441a746-7aff-4535-b227-f9f8a57483b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.157678 Jun 07 16:01:00.589998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 132/281] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:00 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:00.690728 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:00.691471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:00.698793 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.699253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.700094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:00.701044 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:00.717458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.725965 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-beb446cd-a14c-40ec-a0ad-65712a511991 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.194859 Jun 07 16:01:00.726542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 150/282] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:00 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:00.957166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:00.967826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e80e5671-e7fe-421f-a837-c2565f9038d7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.284975 Jun 07 16:01:00.969043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 133/283] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:00 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:01.303883 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:01.305306 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:01.312021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.312791 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.313754 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.314189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.322610 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:01.323214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:01.332815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.344324 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.345416 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.345872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.656586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:01.686103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:01.692233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:01.698425 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bdca35d6-519c-4d0d-948e-8aa9f73cf22c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.396392 Jun 07 16:01:01.710035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 151/284] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:01 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:01.710035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:01.713305 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:01.728744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.729114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.732952 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.733437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.767847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:01.774505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:01.777133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dfc683fe-d172-4f02-bf64-bff2d5f68161 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.458309 Jun 07 16:01:01.788753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 134/285] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:01 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:01.793897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:01.794506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:01.811793 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.812240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:01.813722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:01.813722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.199279 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:02.212511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9a16f5ce-04f1-45e7-8075-64631f0e9506 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1722 microversion: 2.1 time: 0.510777 Jun 07 16:01:02.213852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 152/286] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:01 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:02.215180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:02.219319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:02.220898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:02.226376 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1347e985-5586-41ea-b0c7-d5128c8e7b7a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.436313 Jun 07 16:01:02.227387 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 135/287] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:01 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:02.237608 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.239422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.240454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.240995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.245006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-b68f1574-4fa8-487d-aeb4-b4785891ea5d req-33bbb239-7143-449d-8df9-4c6eba57ae72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "816146bc-5797-4984-a957-b06cd866439d", "tag": "6e57fb6c-90ee-4906-85c3-42d6621fc544"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:02.258865 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-b68f1574-4fa8-487d-aeb4-b4785891ea5d req-33bbb239-7143-449d-8df9-4c6eba57ae72 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.259773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-b68f1574-4fa8-487d-aeb4-b4785891ea5d req-33bbb239-7143-449d-8df9-4c6eba57ae72 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.283902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-b68f1574-4fa8-487d-aeb4-b4785891ea5d req-33bbb239-7143-449d-8df9-4c6eba57ae72 service nova] Creating event network-changed:6e57fb6c-90ee-4906-85c3-42d6621fc544 for instance 816146bc-5797-4984-a957-b06cd866439d on hv-cinder-84487 Jun 07 16:01:02.302237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-b68f1574-4fa8-487d-aeb4-b4785891ea5d req-33bbb239-7143-449d-8df9-4c6eba57ae72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062661 Jun 07 16:01:02.303287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 136/288] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:02.552255 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:02.561490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5591ff43-4e81-49f4-8b36-f3c213d46f9a tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.346354 Jun 07 16:01:02.562077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 153/289] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:02 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:02.719298 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:02.720289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:02.740596 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.743908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.745796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.746836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.797292 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:02.798189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:02.810847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.811463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.812347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:02.814738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:02.826453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=100 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:03.101883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.109815 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.118857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-433224ff-aba9-42d4-8ce0-5c3f4875a1a3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.325316 Jun 07 16:01:03.119479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.120274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 154/290] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:02 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:03.121273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.122593 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c4eff7bd-f392-4a4a-b1d2-7bb94e5e797c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.409067 Jun 07 16:01:03.137945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 137/291] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:02 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:03.232517 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:03.233442 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:03.242936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:03.243818 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:03.246683 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.247142 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.247925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.248461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.250752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.251372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.252125 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.252745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.723490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.732697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-55bdb842-9822-4c1c-95fc-f1070311b35a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.493348 Jun 07 16:01:03.733518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 138/292] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:03 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:03.739545 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:03.740297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:03.748808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.749408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.750119 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.750598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.751421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.771982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a6c278ac-9f05-4b49-b32e-93d663aabd03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1699 microversion: 2.1 time: 0.536578 Jun 07 16:01:03.773224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 155/293] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:03 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1699 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:03.799942 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e7b46e28-15ce-4c86-ba14-131ba485d1fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:03.813614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e7b46e28-15ce-4c86-ba14-131ba485d1fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.814067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e7b46e28-15ce-4c86-ba14-131ba485d1fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.852847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e7b46e28-15ce-4c86-ba14-131ba485d1fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Going to try to start instance {{(pid=117818) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 16:01:03.929408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e7b46e28-15ce-4c86-ba14-131ba485d1fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action" status: 202 len: 0 microversion: 2.1 time: 0.143734 Jun 07 16:01:03.930029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 156/294] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:01:03 2022] POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 16:01:03.939051 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:03.939692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:03.951925 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:03.954807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.955322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.956451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:03.956897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:03.972249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3f3e081a-c299-4a72-ae06-43d0afad0a84 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.237364 Jun 07 16:01:03.976408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 139/295] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:03 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:04.117615 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:04.126389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4983a42a-ca99-43a2-ad12-65530f8775fd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1708 microversion: 2.1 time: 0.191729 Jun 07 16:01:04.126976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 157/296] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:03 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1708 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:04.136396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:04.136986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:04.144632 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.145636 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.146394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.147090 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.148524 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:04.149141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:04.162026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.162765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.163753 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.164987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.378401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:04.381452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:04.390752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-76dd32ff-cb1d-4d62-b1f1-073fc63b14b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.258437 Jun 07 16:01:04.403062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:04.403062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:04.403062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-090d6307-0a48-404e-ac87-6e54ed545c76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.261027 Jun 07 16:01:04.403349 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 158/297] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:04 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:01:04.403802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 140/298] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:04 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:04.698103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-3dcb5e2f-5f94-4765-8cdb-60e3ba39833d req-d4a96b2e-0e38-48ff-9110-eb1614d8d9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "name": "network-vif-plugged", "status": "completed", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:04.730449 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-3dcb5e2f-5f94-4765-8cdb-60e3ba39833d req-d4a96b2e-0e38-48ff-9110-eb1614d8d9f2 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.731004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-3dcb5e2f-5f94-4765-8cdb-60e3ba39833d req-d4a96b2e-0e38-48ff-9110-eb1614d8d9f2 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.752486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:04.753406 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:04.776990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.777693 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.778576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-3dcb5e2f-5f94-4765-8cdb-60e3ba39833d req-d4a96b2e-0e38-48ff-9110-eb1614d8d9f2 service nova] Creating event network-vif-plugged:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:01:04.779199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:04.779779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:04.795264 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-3dcb5e2f-5f94-4765-8cdb-60e3ba39833d req-d4a96b2e-0e38-48ff-9110-eb1614d8d9f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103446 Jun 07 16:01:04.800053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 159/299] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:04.992856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:04.994022 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:05.008154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.008606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.009449 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.010921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.396677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:05.411742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ef74ad82-89cb-4945-9396-ca622d1c5f6f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.662785 Jun 07 16:01:05.422906 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 141/300] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:04 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:05.429519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:05.430410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:05.438577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.439394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.440441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.441060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.578128 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:05.589400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0d193774-113f-4eeb-9af4-9cd1cc04806c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.598217 Jun 07 16:01:05.589998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 160/301] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:04 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:05.604074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:05.604651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:05.615313 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.616012 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.617029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.617618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.758710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:05.768808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f85f7870-382d-4c88-a809-52927eb82b63 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1708 microversion: 2.1 time: 0.344346 Jun 07 16:01:05.770390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 142/302] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:05 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1708 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:05.785183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:05.786252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:05.796329 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.797087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.798072 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:05.798679 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:05.931904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:05.958651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-21882d39-93ba-4d2a-a213-9205538255cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.367178 Jun 07 16:01:05.959269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 161/303] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:05 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:06.013507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.029516 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.031024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.032205 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4b450839-26ba-4b96-8147-07c3e170c747 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.250973 Jun 07 16:01:06.033061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 143/304] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:05 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:06.431019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:06.433078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:06.442058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.442928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.443863 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.444654 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.606451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.606709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:06.607192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:06.617514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e76a449e-79dc-417f-a52c-907ad3648fc5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.191711 Jun 07 16:01:06.618283 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 162/305] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:06 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:06.625908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.628693 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.629839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.631495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.785589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.787025 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:06.787825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:06.794398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ec89058a-9f16-4f59-be84-cc5ed6d84b47 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.191765 Jun 07 16:01:06.794562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.794969 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.804751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.804751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.805528 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 144/306] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:06 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:06.957394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:06.967018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-18f49c65-a91d-4b66-bb28-fedc06db80bc tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1708 microversion: 2.1 time: 0.183806 Jun 07 16:01:06.968452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 163/307] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:06 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:06.977674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:06.978589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:06.985927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.986662 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:06.987718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:06.989139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.052133 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:07.052781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:07.054870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:07.066001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.066678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.068530 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.069019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.169534 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=12 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:07.238076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:07.250543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2712e886-b10c-423a-b984-9739e3bd25c0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.278938 Jun 07 16:01:07.264116 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 145/308] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:06 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:07.284896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:07.324407 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:07.333947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:07.335041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-452c9fea-7a95-4946-9f7e-e2c464a61db7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.287775 Jun 07 16:01:07.335840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 164/309] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:07 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:01:07.636455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:07.637289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:07.643941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.644757 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.646676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.647297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.812951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:07.813845 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:07.836349 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.837100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.838085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.838679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.862347 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:07.872702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b739add6-4523-48f9-a54c-691680528669 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.241362 Jun 07 16:01:07.888875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 146/310] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:07 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:07.985468 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:07.986416 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:07.996213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.996879 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:07.997827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:07.998260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.176667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.184748 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-af1012ee-dbf4-4144-9a7f-9595fec29e25 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1259 microversion: 2.1 time: 0.375681 Jun 07 16:01:08.185634 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 165/311] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:07 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1259 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:08.238876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.248567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7d07a49f-2f61-4102-86ef-fa2f233246e0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1712 microversion: 2.1 time: 0.266855 Jun 07 16:01:08.260144 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 147/312] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:07 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1712 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:08.268470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:08.269085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:08.275192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.275645 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.276432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.276870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.360913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:08.363021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:08.379491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.380791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.390352 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.392228 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.421896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.431058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b71db7f9-5edb-4676-a66a-4e7783ac8cc9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.166383 Jun 07 16:01:08.431885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 166/313] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:08 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:08.538050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.548063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.549787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:08.551246 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b736451a-d8c5-4f9c-9976-93b0e6552f7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1738 microversion: 2.20 time: 0.201598 Jun 07 16:01:08.551804 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 148/314] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:08 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:01:08.688881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-c57ca901-6387-442e-8e3d-863c659b83ae req-e3fdfcb2-0a73-4e90-bd3b-2a52f5970ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "816146bc-5797-4984-a957-b06cd866439d", "name": "network-vif-plugged", "status": "completed", "tag": "6e57fb6c-90ee-4906-85c3-42d6621fc544"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:08.697597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c57ca901-6387-442e-8e3d-863c659b83ae req-e3fdfcb2-0a73-4e90-bd3b-2a52f5970ba6 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.698100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c57ca901-6387-442e-8e3d-863c659b83ae req-e3fdfcb2-0a73-4e90-bd3b-2a52f5970ba6 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.710241 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-c57ca901-6387-442e-8e3d-863c659b83ae req-e3fdfcb2-0a73-4e90-bd3b-2a52f5970ba6 service nova] Creating event network-vif-plugged:6e57fb6c-90ee-4906-85c3-42d6621fc544 for instance 816146bc-5797-4984-a957-b06cd866439d on hv-cinder-84487 Jun 07 16:01:08.715037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-c57ca901-6387-442e-8e3d-863c659b83ae req-e3fdfcb2-0a73-4e90-bd3b-2a52f5970ba6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 Jun 07 16:01:08.715641 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 167/315] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:08.890924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:08.891544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:08.897798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.898242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:08.899003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:08.899439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.038216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.045643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0612a3a6-eed2-4832-a476-4fdd3c264581 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.158587 Jun 07 16:01:09.046211 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 149/316] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:08 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:09.202934 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:09.203624 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:09.209878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.210394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.211070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.211506 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.448218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:09.448475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:09.454974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.455613 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.456599 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.457756 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.482127 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.490996 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f19018fe-ac9e-471b-8fa7-3edd31cf5415 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1444 microversion: 2.1 time: 0.292522 Jun 07 16:01:09.492008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 168/317] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:09 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1444 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:09.510882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:09.511739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:09.518202 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.518775 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.520834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.521400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.745218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.752711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0104931f-36da-4ca8-b06d-c499a2b25a1b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.308730 Jun 07 16:01:09.762552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 150/318] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:09 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:09.762552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:09.762552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:09.764866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.765314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.766069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:09.766498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:09.779029 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.787814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fb068fde-5dc7-41e8-9715-442f235f111b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1444 microversion: 2.1 time: 0.280774 Jun 07 16:01:09.788802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 169/319] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:09 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1444 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:09.930209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.938929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.940468 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:09.942336 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8b69c8e2-f81f-4dff-84de-cd2155617438 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1720 microversion: 2.20 time: 0.186916 Jun 07 16:01:09.942939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 151/320] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:09 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:10.063622 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:10.064237 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:10.070255 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:10.070697 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:10.071445 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:10.071872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:10.211283 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:10.219267 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7f8ab148-0135-42ba-b30a-8ead6ea16ce3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.159510 Jun 07 16:01:10.219906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 170/321] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:10 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:10.602112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1303638237", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:10.655461 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] validate_networks() for None {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:01:10.770908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:10.771702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:10.778750 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:10.779203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:10.780657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:10.781104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:10.787657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:11.172912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.180754 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9c98d76e-4ce5-4410-987b-ee8a54b4e14b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.414292 Jun 07 16:01:11.186361 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 171/322] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:10 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:11.190812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:11.191828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:11.204399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.204850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.205918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.206038 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.237977 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:01:11.238601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:01:11.239112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:01:11.239521 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:01:11.239931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:01:11.249190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.249639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.250428 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.250856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.259581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:11.271736 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Getting quotas for project 4bd3c10c39cd4e2282cc954487fee86c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:01:11.275895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Getting quotas for user abbcee9af1d9400ba851d2b8b24e6532 and project 4bd3c10c39cd4e2282cc954487fee86c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:01:11.288758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:01:11.291040 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:01:11.348145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b2beec0d-026a-40d0-8019-4b63c1f5f3da tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750043 Jun 07 16:01:11.354806 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 152/323] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:01:11.360347 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:11.361166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:11.369771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.370222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.371305 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.371741 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.373502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.384202 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.385865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.387044 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bf244c81-79b0-4682-bd0f-c0defa528883 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1720 microversion: 2.20 time: 0.199849 Jun 07 16:01:11.388000 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 172/324] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:11 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:11.392954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-977928cd-63c2-4d3c-8fd4-aba275f35bef tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:11.393569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-977928cd-63c2-4d3c-8fd4-aba275f35bef tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:11.472171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-977928cd-63c2-4d3c-8fd4-aba275f35bef tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.484030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-977928cd-63c2-4d3c-8fd4-aba275f35bef tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1215 microversion: 2.1 time: 0.093500 Jun 07 16:01:11.485003 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 173/325] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:11 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:11.564337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:11.572884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9a83a0b5-86f2-49cb-b232-62548ca7a9bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1367 microversion: 2.1 time: 0.219145 Jun 07 16:01:11.573690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 153/326] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:11 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:11.791633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-90ee0ac5-ad89-4dd2-a96b-07b4fa09a457 req-7d398cf4-46f5-4a5e-8a22-963958b7ca38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:11.799780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-90ee0ac5-ad89-4dd2-a96b-07b4fa09a457 req-7d398cf4-46f5-4a5e-8a22-963958b7ca38 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:11.800227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-90ee0ac5-ad89-4dd2-a96b-07b4fa09a457 req-7d398cf4-46f5-4a5e-8a22-963958b7ca38 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:11.812008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-90ee0ac5-ad89-4dd2-a96b-07b4fa09a457 req-7d398cf4-46f5-4a5e-8a22-963958b7ca38 service nova] Creating event network-changed:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:01:11.817647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-90ee0ac5-ad89-4dd2-a96b-07b4fa09a457 req-7d398cf4-46f5-4a5e-8a22-963958b7ca38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029577 Jun 07 16:01:11.818254 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 174/327] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:01:12.203052 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:12.203582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:12.210131 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.210576 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.211321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.211751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.352101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.367424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6fc74278-30ae-4134-af92-5e6f2d2c3665 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.166348 Jun 07 16:01:12.370325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 154/328] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:12 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:12.407402 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:12.408130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:12.416415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.416870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.417743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.418343 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.501511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:12.502153 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:12.509702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.510459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.511376 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.511958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.573735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.589534 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.590088 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.591298 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.592779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1246c2f9-f511-454b-a1a5-ba2e82fa54e5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1720 microversion: 2.20 time: 0.190893 Jun 07 16:01:12.593918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 175/329] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:12 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:12.599180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:12.600056 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:12.600766 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-338d8579-96ce-41bd-b8c2-24e98eeaffd4 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1219 microversion: 2.1 time: 0.103271 Jun 07 16:01:12.606177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 155/330] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:12 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:12.609821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.610498 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.611475 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.612116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.627015 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-06aed62b-04c9-4645-ad51-cb4b180577e9 req-41de8e31-aa65-4ecd-9f82-7dc97328e46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "name": "network-vif-unplugged", "status": "completed", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:12.638851 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-06aed62b-04c9-4645-ad51-cb4b180577e9 req-41de8e31-aa65-4ecd-9f82-7dc97328e46b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.639552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-06aed62b-04c9-4645-ad51-cb4b180577e9 req-41de8e31-aa65-4ecd-9f82-7dc97328e46b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.652913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-06aed62b-04c9-4645-ad51-cb4b180577e9 req-41de8e31-aa65-4ecd-9f82-7dc97328e46b service nova] Creating event network-vif-unplugged:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 16:01:12.658396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-06aed62b-04c9-4645-ad51-cb4b180577e9 req-41de8e31-aa65-4ecd-9f82-7dc97328e46b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037246 Jun 07 16:01:12.659100 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 156/331] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:01:12.758083 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:12.765953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cfbfb1f4-a581-4237-ad07-e09c73372c39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1555 microversion: 2.1 time: 0.170787 Jun 07 16:01:12.766543 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 176/332] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:12 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:12.783815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:12.785314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:12.795711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.796156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.796990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:12.797362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:12.939252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-70fd90ad-efc8-4844-aa91-4d0490bf8a03 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159736 Jun 07 16:01:12.954067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 157/333] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:01:12 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:13.386899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:13.387540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:13.393636 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.394078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.395376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.395815 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.529522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:13.538418 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-00a388ee-99f2-41ab-845c-620f9afaf836 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.155282 Jun 07 16:01:13.539184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 177/334] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:13 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:13.612797 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:13.614018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:13.618271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:13.618955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:13.621119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.621819 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.622847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.623499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.625569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.626333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.626770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:13.790715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:13.801265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d1e9c1db-6cbb-4d4d-8f5c-6aa96dea04dc tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1275 microversion: 2.1 time: 0.187333 Jun 07 16:01:13.810790 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 178/335] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:13 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:13.971278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:13.981447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-fa39e3ac-92b5-4f33-88d2-b534c2a4c254 req-a4a3f98b-637d-4269-a8f7-8d01d0f15304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "816146bc-5797-4984-a957-b06cd866439d", "tag": "6e57fb6c-90ee-4906-85c3-42d6621fc544"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:13.986107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:13.987659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:13.989530 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7b7e4eb6-ab55-46a4-b258-8bc2ad55feb8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1663 microversion: 2.20 time: 0.381560 Jun 07 16:01:13.990343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 158/336] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:13 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1663 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:13.990904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa39e3ac-92b5-4f33-88d2-b534c2a4c254 req-a4a3f98b-637d-4269-a8f7-8d01d0f15304 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:13.991514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa39e3ac-92b5-4f33-88d2-b534c2a4c254 req-a4a3f98b-637d-4269-a8f7-8d01d0f15304 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.002792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-fa39e3ac-92b5-4f33-88d2-b534c2a4c254 req-a4a3f98b-637d-4269-a8f7-8d01d0f15304 service nova] Creating event network-changed:6e57fb6c-90ee-4906-85c3-42d6621fc544 for instance 816146bc-5797-4984-a957-b06cd866439d on hv-cinder-84487 Jun 07 16:01:14.007795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "981ba9ca-9b94-4019-972d-2a5a64469129"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:14.008064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-fa39e3ac-92b5-4f33-88d2-b534c2a4c254 req-a4a3f98b-637d-4269-a8f7-8d01d0f15304 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030449 Jun 07 16:01:14.008728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 179/337] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:14.009183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:14.015627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.016069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.016845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.017307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.299541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-41538cd3-5477-4a29-ab0e-cc35a09d51ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296282 Jun 07 16:01:14.300301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 159/338] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Jun 7 16:01:14 2022] POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 16:01:14.419412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:14.420069 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:14.426963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.427618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.428413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.428855 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.521959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-41dd4dcf-6f2a-4c29-a75d-866d061eb7b7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/action" status: 202 len: 0 microversion: 2.20 time: 0.106035 Jun 07 16:01:14.522849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 180/339] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 7 16:01:14 2022] POST /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:01:14.530857 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:14.531457 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:14.533518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:14.541383 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.541820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.543265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.543265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.557222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:14.558635 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:14.569649 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.570213 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.571122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.571720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.773141 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:14.777897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:14.786735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:14.787112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cef18204-03e1-42fe-963b-5e316835274b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.234599 Jun 07 16:01:14.788556 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 181/340] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:14 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:14.790256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:14.791538 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-91776c1f-af72-4885-954a-11d83edf52b2 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1749 microversion: 2.20 time: 0.264511 Jun 07 16:01:14.792261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 160/341] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:14 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1749 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:14.818140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:14.818734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:14.824917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.825376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.826222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:14.826587 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:14.892473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:14.901363 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-81294cd4-ff17-45c5-8710-01be752e321c tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1273 microversion: 2.1 time: 0.087035 Jun 07 16:01:14.910898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 182/342] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:14 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:15.811313 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:15.812192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:15.813021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:15.814299 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:15.823948 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:15.824150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:15.824505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:15.824679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:15.825560 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:15.825688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:15.826050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:15.826547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:16.078557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:16.083453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:16.086913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3f4c6b03-8f53-4ef5-bbd9-3cef2ab3b929 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1520 microversion: 2.1 time: 0.286336 Jun 07 16:01:16.087833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 161/343] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:15 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:16.092233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:16.092712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:16.093316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:16.093780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:16.095130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b0a54bca-2bd2-4a78-a8b9-5d364c0954a1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1751 microversion: 2.20 time: 0.288456 Jun 07 16:01:16.096134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 183/344] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:15 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1751 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:16.099583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:16.100211 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:16.101359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:16.101798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:16.578216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:16.586899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c0127187-52ed-46c6-9b1f-4298f50b7878 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.497796 Jun 07 16:01:16.587598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 162/345] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:16 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:17.103630 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:17.104243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:17.111098 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.111542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.112290 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.112744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.114208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:17.114845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:17.121293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.121738 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.122492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.122930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.375432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.384652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b8cdddf1-bd86-4830-ac7c-c0ab443aa10b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1500 microversion: 2.1 time: 0.284693 Jun 07 16:01:17.385447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 184/346] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:17 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1500 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:17.401516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:17.402337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:17.403049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.404373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:17.413087 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.413548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.414499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.415552 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.428295 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.431258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.433446 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9f3d68ef-064b-453c-befa-9fabf1f88631 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1751 microversion: 2.20 time: 0.323488 Jun 07 16:01:17.434445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 163/347] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:17 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1751 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:01:17.603551 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:17.604135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:17.610479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.610934 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.611691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:17.612128 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:17.706619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.715692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f409ab05-2364-4e09-b334-81ef816d3947 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1516 microversion: 2.1 time: 0.318068 Jun 07 16:01:17.716653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 185/348] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:17 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1516 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:17.835548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:17.848242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9cb0f07f-2563-4349-ac74-726c10fe6c03 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.248175 Jun 07 16:01:17.849138 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 164/349] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:17 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:18.451042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:18.451669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:18.458810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:18.459266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:18.460019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:18.460486 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:18.508805 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-2a9cc59e-c017-4805-b67a-2e47fafa409d req-f411f2f4-4e5f-4e18-9fbc-9db25003ae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f1ede5-bcf8-4698-8d27-b69d90fc3db4", "tag": "2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:18.525856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2a9cc59e-c017-4805-b67a-2e47fafa409d req-f411f2f4-4e5f-4e18-9fbc-9db25003ae5f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:18.526691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2a9cc59e-c017-4805-b67a-2e47fafa409d req-f411f2f4-4e5f-4e18-9fbc-9db25003ae5f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:18.540846 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-2a9cc59e-c017-4805-b67a-2e47fafa409d req-f411f2f4-4e5f-4e18-9fbc-9db25003ae5f service nova] Creating event network-changed:2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5 for instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 on hv-cinder-84487 Jun 07 16:01:18.546685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-2a9cc59e-c017-4805-b67a-2e47fafa409d req-f411f2f4-4e5f-4e18-9fbc-9db25003ae5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044776 Jun 07 16:01:18.548671 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 165/350] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:01:18.804734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:18.813062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:18.814574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:18.815713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-78bce24e-67e8-4552-85d6-902958b81a76 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.368596 Jun 07 16:01:18.816266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 186/351] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:18 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:18.866101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:18.866901 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:18.873333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:18.873786 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:18.874548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:18.874981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.111858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:19.112921 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:19.119157 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.119610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.120426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.120859 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.124451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:19.135707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7782b472-0549-4e0a-90c1-90d8837a9516 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.273734 Jun 07 16:01:19.136552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 166/352] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:18 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:19.148934 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'flavor' on Instance uuid 3def1191-4ee0-45d7-b43f-2e16de89e478 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:01:19.195860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:19.225781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d959570d-bd84-48ba-9e63-256cc42e9552 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/action" status: 200 len: 32 microversion: 2.1 time: 0.118052 Jun 07 16:01:19.226376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 187/353] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:01:19 2022] POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 16:01:19.235797 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:19.236571 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:19.242856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.243522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.244291 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.244855 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.390842 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:19.398902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c4d74d0c-fdc2-4772-87d3-bde6278c889b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.166984 Jun 07 16:01:19.399527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 167/354] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:19 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:19.835200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:19.835823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:19.842527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.842971 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.843719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:19.844155 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:19.981123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:19.990371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:19.991873 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:19.993043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-108509f2-059a-47f9-90eb-f7a2ef4575b0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.162651 Jun 07 16:01:19.993595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 188/355] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:19 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:20.152683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:20.153287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:20.159707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:20.160927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:20.161819 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:20.162251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:20.176942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:20.292928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:20.300212 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8a4dc98b-4d23-4f8e-a42c-3f2123373f86 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.151340 Jun 07 16:01:20.300932 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 168/356] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:20 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:20.416140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:20.416792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:20.423073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:20.423612 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:20.424432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:20.424927 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:20.578511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:20.587848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-65ea56b8-66ce-406f-ad21-725f380fc351 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.175556 Jun 07 16:01:20.588758 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 189/357] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:20 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:21.011262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:21.011881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:21.018224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.018664 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.019432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.019862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.164391 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:21.176218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:21.177801 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:21.178991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a198c697-83c0-4678-bb61-420b18c81a9b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.171780 Jun 07 16:01:21.179875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 169/358] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:21 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:21.316936 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:21.317456 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:21.324021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.324510 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.325301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.325726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.458840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:21.466899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-77063fac-3027-4b1c-a139-63323898c37f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.153904 Jun 07 16:01:21.467666 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 190/359] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:21 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:21.615330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:21.616746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:21.618678 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:21.619328 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:21.630391 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.634485 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.635315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:21.635763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:21.777778 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:21.786055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7b20bf59-6f04-4a92-a49f-22a6758e3d28 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.183416 Jun 07 16:01:21.786680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 170/360] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:21 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:22.197806 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:22.198432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:22.200383 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:22.206168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.206614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.207384 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.207982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.365058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:22.374078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:22.375779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:22.377074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f3d888e5-3a78-477f-91b9-78294f59d548 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.183177 Jun 07 16:01:22.377689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 191/361] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:22 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:22.484342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:22.485025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:22.491968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.492436 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.493194 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.493623 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.637000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:22.646587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-426c8667-12a6-4ae1-9277-b12b1d9c8e81 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.166335 Jun 07 16:01:22.655773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 171/362] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:22 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:22.738445 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-23b0c79f-f72a-4bc7-85a0-e98114269bc7 req-70734c7d-77a8-4314-a547-d24a4cd9c956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f1ede5-bcf8-4698-8d27-b69d90fc3db4", "name": "network-vif-plugged", "status": "completed", "tag": "2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:22.747042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-23b0c79f-f72a-4bc7-85a0-e98114269bc7 req-70734c7d-77a8-4314-a547-d24a4cd9c956 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.747661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-23b0c79f-f72a-4bc7-85a0-e98114269bc7 req-70734c7d-77a8-4314-a547-d24a4cd9c956 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.760153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-23b0c79f-f72a-4bc7-85a0-e98114269bc7 req-70734c7d-77a8-4314-a547-d24a4cd9c956 service nova] Creating event network-vif-plugged:2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5 for instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 on hv-cinder-84487 Jun 07 16:01:22.764968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-23b0c79f-f72a-4bc7-85a0-e98114269bc7 req-70734c7d-77a8-4314-a547-d24a4cd9c956 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Jun 07 16:01:22.765571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 192/363] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:22.803081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:22.804058 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:22.818841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.819216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.819975 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:22.820420 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:22.957743 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:22.965435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-db15bd10-ef8c-4fb8-9f55-aace5a9b0739 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.166434 Jun 07 16:01:22.966011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 172/364] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:22 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:23.396650 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:23.397357 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:23.404113 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.404538 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:23.405313 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.405756 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:23.541243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:23.549966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:23.552533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:23.553689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a162a9fd-106a-4d0b-a67f-2cba1be8323f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.162262 Jun 07 16:01:23.554567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 193/365] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:23 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:23.663171 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:23.663812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:23.670634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.671120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:23.671926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.672392 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:23.809906 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:23.818309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9ee49a9c-b76a-4076-adc6-e9280be5f382 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.159119 Jun 07 16:01:23.818895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 173/366] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:23 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:23.982978 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:23.983856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:23.990594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.991037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:23.991792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:23.992223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:24.138293 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:24.146134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4c3f5e54-a19c-4981-b16d-55034a7a8c09 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.167287 Jun 07 16:01:24.146908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 194/367] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:23 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:24.573234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:24.573959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:24.580241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:24.580719 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:24.581483 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:24.582232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:24.721102 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:24.731012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:24.732554 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:24.734181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9f10040f-3167-44a2-91a3-0750ee94d64b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.164947 Jun 07 16:01:24.740642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 174/368] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:24 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:24.835658 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:24.836920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:24.843576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:24.844031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:24.845023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:24.845529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:24.979446 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:24.987403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-41aec513-2ff5-42f4-8acf-94a1771af67d tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.156404 Jun 07 16:01:24.988112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 195/369] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:24 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:25.163125 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:25.163737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:25.169816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:25.170265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:25.171019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:25.171452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:25.309774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:25.317784 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8f8e51ea-34f7-4966-81b7-0dd422a508db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.158689 Jun 07 16:01:25.318347 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 175/370] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:25 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:25.753356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:25.753883 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:25.760161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:25.760648 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:25.761504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:25.761933 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:25.891363 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:25.900265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:25.901880 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:25.903236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5d4e5e87-9eed-4dd3-91d9-b1ecbe6a016f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.153880 Jun 07 16:01:25.903790 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 196/371] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:25 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:26.005312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:26.005952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:26.012945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.013403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:26.014166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.014602 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:26.149971 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:26.157911 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-27317772-f4ca-4444-8423-21f7054bec07 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.156713 Jun 07 16:01:26.158749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 176/372] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:25 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:26.335438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:26.335955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:26.342051 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.342497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:26.343243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.343675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:26.481372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:26.489509 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-07253531-530b-436e-9af2-7ba9d9343648 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.158806 Jun 07 16:01:26.490269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 197/373] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:26 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:26.921613 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:26.922296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:26.930049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.930721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:26.931628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:26.932061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:27.071624 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:27.080095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:27.081640 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:27.082856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9e3cfddc-9dfa-4980-ab2c-97626d07a405 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.165284 Jun 07 16:01:27.083409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 177/374] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:26 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:27.175427 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:27.177368 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:27.182814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:27.183268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:27.184027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:27.184486 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:27.505704 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:27.506284 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:27.517236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:27.517677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:27.518453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:27.518887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:27.574998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:27.583251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-03127d88-0613-48bf-aee3-e7681d3f320a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.411796 Jun 07 16:01:27.584017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 198/375] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:27 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:27.666629 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:27.674283 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-94a2951e-7b85-4e77-8d20-86aebdf22fc2 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.172494 Jun 07 16:01:27.674860 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 178/376] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:27 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:28.101869 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:28.102480 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:28.108993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.109439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.110332 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.110823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.249558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:28.258930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:28.260450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:28.261598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-67fb06fa-fc4d-4037-a46e-2a9ba9edd767 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.164305 Jun 07 16:01:28.262156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 199/377] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:28 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:28.599393 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:28.599998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:28.606800 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.607246 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.608007 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.608465 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.690916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:28.692106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:28.703743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.704212 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.704987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:28.705426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:28.753478 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:28.761621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f1e603b7-3117-4730-8236-4f96b23442dd tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.166093 Jun 07 16:01:28.770956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 179/378] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:28 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:28.862104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:28.870527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e78ec938-05cc-4b23-864e-349872aaa0c4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.183480 Jun 07 16:01:28.871103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 200/379] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:28 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:29.280515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:29.281219 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:29.288342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.288876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.289697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.290197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.427975 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:29.437180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:29.438679 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:29.439868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dbfefb5b-559b-4d87-a378-f3fa7155cda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.163332 Jun 07 16:01:29.440440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 180/380] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:29 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:29.779014 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:29.779584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:29.787002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.787460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.788243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.788715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.887241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:29.887833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:29.895907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.896414 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.897254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:29.897684 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:29.929211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:29.938127 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e91dea97-0761-4102-b17c-6eba3da08628 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.163154 Jun 07 16:01:29.938728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 201/381] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:29 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:30.038074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:30.051239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a06d8c91-2c35-4a27-9dcf-65368c8d3e14 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.167635 Jun 07 16:01:30.051835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 181/382] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:29 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:30.459788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:30.460306 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:30.466593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:30.467041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:30.467802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:30.468229 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:30.603168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:30.612064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:30.614596 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:30.615832 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bbd67f7e-2c67-4298-a32c-974291ddf93d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.161017 Jun 07 16:01:30.616463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 202/383] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:30 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:30.955008 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:30.955721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:30.962554 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:30.963200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:30.964037 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:30.964600 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:31.068585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:31.069218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:31.075995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:31.076569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:31.077439 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:31.077872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:31.102854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:31.111068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2a474539-3e0b-4ddb-bcd1-6351e706677f tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.159880 Jun 07 16:01:31.111900 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 182/384] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:30 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:31.219481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:31.227765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-32d2024a-ecc3-4e9a-8c23-07d6a7e73a6b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.163127 Jun 07 16:01:31.228334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 203/385] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:31 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:31.634603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:31.635403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:31.641655 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:31.642150 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:31.642868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:31.643313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:31.789218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:31.801406 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:31.802949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:31.804127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a93d4049-a573-4cf4-ba7e-48ac3ab5898e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.173498 Jun 07 16:01:31.804724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 183/386] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:31 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:32.128067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:32.128736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:32.136177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.136687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:32.137494 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.137931 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:32.158489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:32.245000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:32.245648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:32.252072 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.252564 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:32.253327 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.254544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:32.385385 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:32.393853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-872e1da3-66fe-4da2-83ff-c18d37bbd46e tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.269519 Jun 07 16:01:32.395555 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 204/387] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:32 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:32.422754 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:32.430595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-acb08b48-4726-4a4f-888f-f6333ef8c27e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.189480 Jun 07 16:01:32.431168 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 184/388] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:32 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:32.823330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:32.823944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:32.829995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.830433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:32.831183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:32.832263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:33.167344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:33.177086 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:33.178613 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:33.179774 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2dfd48ed-ba5c-496f-afa6-ac08601f0bc5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.360638 Jun 07 16:01:33.180346 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 205/389] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:32 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:33.412536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:33.413173 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:33.419703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:33.420142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:33.420913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:33.421345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:33.423815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:33.448103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:33.448778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:33.454948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:33.455396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:33.456151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:33.456757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:33.757716 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:33.765051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b019a22a-7c19-419c-ba72-b3a9e8ba027a tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1315 microversion: 2.1 time: 0.356455 Jun 07 16:01:33.765563 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 185/390] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:33 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:33.783134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:33.790703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-73bf3e81-2001-4b0f-b712-87bf774ae107 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.346478 Jun 07 16:01:33.791255 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 206/391] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:33 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:34.198112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:34.198775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:34.204892 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.205331 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.206094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.206525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.429092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:34.437464 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:34.438956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:34.440244 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6d0bb349-ee7b-45b3-80d9-ff97f67cac4d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.246198 Jun 07 16:01:34.440841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 186/392] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:34 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:34.781516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:34.782053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:34.788959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.789406 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.790161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.790597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.807086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:34.807694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:34.813591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.814033 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.814781 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:34.815210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:34.980718 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:34.988221 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7e4a18fa-5bb8-4810-9f57-a0acf94c9241 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1464 microversion: 2.1 time: 0.210665 Jun 07 16:01:34.988886 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 207/393] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:34 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:34.994654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:35.002958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ae53fe2d-1377-4338-b9da-0a93aa49993c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.199569 Jun 07 16:01:35.004411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 187/394] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:34 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:01:35.030728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:35.031225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:35.037624 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.038013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.038770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.039203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.063094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:01:35.145435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-667f76e8-474e-4f83-ac83-ffc4fe615483 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 204 len: 0 microversion: 2.1 time: 0.118135 Jun 07 16:01:35.146018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 208/395] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:01:35 2022] DELETE /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:01:35.154121 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:35.154768 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:35.160923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.161835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.162659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.163113 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.304294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:35.312153 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9b8eebc5-cef8-45f6-a4ba-00406439fe44 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1470 microversion: 2.1 time: 0.161808 Jun 07 16:01:35.313257 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 188/396] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:35 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:35.459070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:35.460303 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:35.469784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.470573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.471348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:35.471784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:35.619917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:35.630099 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:35.632228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:35.633706 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c9966e45-1002-4ec8-bcf7-95b6e47d4af3 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.179266 Jun 07 16:01:35.634279 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 209/397] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:35 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:36.021549 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:36.022157 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:36.029062 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.029910 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.031241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.032035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.170571 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:36.178085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e28ba5e3-8ada-42f3-b2a8-bcab24a91a53 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.161393 Jun 07 16:01:36.178669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 189/398] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:36 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:36.331346 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:36.331943 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:36.339110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.339563 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.340328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.340801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.467459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:36.474908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fc1cd687-684c-464b-820d-0d6f479cc248 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1470 microversion: 2.1 time: 0.147708 Jun 07 16:01:36.475481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 210/399] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:36 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:36.651029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:36.651636 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:36.657634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.658072 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.658819 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:36.659249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:36.787846 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:36.796184 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:36.797699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:36.798834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-927ae9dc-d58a-4fe0-8c5a-4c3ebb087821 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.151706 Jun 07 16:01:36.799386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 190/400] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:36 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:37.195107 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:37.195719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:37.201927 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.202404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.203163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.203600 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.414387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:37.422486 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1826c21a-5766-4656-99e2-78dd6893479a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.231340 Jun 07 16:01:37.432223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 211/401] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:37 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:37.491733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:37.492439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:37.498600 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.499041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.499816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.500213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.698106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:37.705572 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2055590c-68b3-4077-8d13-cc7d0c2c8450 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1470 microversion: 2.1 time: 0.217804 Jun 07 16:01:37.706273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 191/402] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:37 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:37.817618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-84556683-a26a-40cb-9b3e-8c2e423e8d66 req-c53006e7-690c-478e-ba88-3987c6e594a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f1ede5-bcf8-4698-8d27-b69d90fc3db4", "name": "network-vif-deleted", "tag": "2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:37.819911 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:37.824740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:37.831632 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.832733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.833502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.833931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.836617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-84556683-a26a-40cb-9b3e-8c2e423e8d66 req-c53006e7-690c-478e-ba88-3987c6e594a7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:37.837114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-84556683-a26a-40cb-9b3e-8c2e423e8d66 req-c53006e7-690c-478e-ba88-3987c6e594a7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:37.867260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-84556683-a26a-40cb-9b3e-8c2e423e8d66 req-c53006e7-690c-478e-ba88-3987c6e594a7 service nova] Creating event network-vif-deleted:2bb8d83a-fa0b-4cfa-856e-6a0f3f7a61c5 for instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 on hv-cinder-84487 Jun 07 16:01:37.872254 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-84556683-a26a-40cb-9b3e-8c2e423e8d66 req-c53006e7-690c-478e-ba88-3987c6e594a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059805 Jun 07 16:01:37.872898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 212/403] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:37.979437 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:37.988232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:37.990294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:37.991445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f0c35e60-1b9e-4ac9-842f-0882701cb628 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.177996 Jun 07 16:01:37.991996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 192/404] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:37 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:01:38.439612 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:38.440307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:38.447327 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:38.447779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:38.448574 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:38.449013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:38.574039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:38.581385 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-80b793ca-b078-48f0-9991-cb263349aadc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.146030 Jun 07 16:01:38.582529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 213/405] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:38 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:38.722409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:38.723051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:38.729231 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:38.729680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:38.730680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:38.731112 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:38.762074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:38.762515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:38.762953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lazy-loading 'fault' on Instance uuid 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:01:38.805953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbcee9af1d9400ba851d2b8b24e6532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd3c10c39cd4e2282cc954487fee86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:38.813364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-fd068b9f-03cd-4087-84fe-ddf8a81e3dae tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 200 len: 1305 microversion: 2.1 time: 0.094987 Jun 07 16:01:38.813914 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 193/406] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:38 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:39.009862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:39.010405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:39.016428 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.016872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.017618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.018049 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.145713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:39.154117 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:39.155616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:39.156772 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b224421e-7dec-40a9-b45c-aa12fb56b563 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.150838 Jun 07 16:01:39.157323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 214/407] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:39 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:39.599456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:39.600071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:39.606301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.606749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.607501 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.607936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.733306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:39.741881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-57d2e152-f719-4ba3-a46e-5596971fb746 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.147123 Jun 07 16:01:39.742470 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 194/408] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:39 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:39.830659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:39.831265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] [instance: 37f1ede5-bcf8-4698-8d27-b69d90fc3db4] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:39.838446 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.838887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.839633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:39.840062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:39.853595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] HTTP exception thrown: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Request method failure captured: Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 HTTP/1.1 Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3ZF2_DJYxFwn82pd5yDgWla1cWIxi31t-SGe7j0Fxs0eZLDt-RLvuI0o1VLPpdm2vnAQIOiMywu1vvY7r9OSEN7-CKI9qiV8EZsbqtoL7aCE93KreKOtDDBlItVS2tmAXoaywWvdNHqHYm1-oqB6_sGK9rahjQw1UmGzdZE_fQYChU Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 4bd3c10c39cd4e2282cc954487fee86c Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-VolumesNegativeTest-1650796977 Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:01:39.855458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bd3c10c39cd4e2282cc954487fee86c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bd3c10c39cd4e2282cc954487fee86c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bd3c10c39cd4e2282cc954487fee86c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bd3c10c39cd4e2282cc954487fee86c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-VolumesNegativeTest-1650796977 Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 4bd3c10c39cd4e2282cc954487fee86c Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-VolumesNegativeTest-1650796977 Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-VolumesNegativeTest-1650796977-project Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: abbcee9af1d9400ba851d2b8b24e6532 Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-VolumesNegativeTest-1650796977-project Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. Jun 07 16:01:39.856972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '37f1ede5-bcf8-4698-8d27-b69d90fc3db4'} Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:01:39.857888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. Jun 07 16:01:39.859309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:01:39.860768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] Returning 404 to user: Instance 37f1ede5-bcf8-4698-8d27-b69d90fc3db4 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:01:39.860768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-31822e44-bf7c-4cb8-b66d-e97731221561 tempest-VolumesNegativeTest-1650796977 tempest-VolumesNegativeTest-1650796977-project] 10.222.0.18 "GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4" status: 404 len: 111 microversion: 2.1 time: 0.030108 Jun 07 16:01:39.860768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 215/409] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:39 2022] GET /compute/v2.1/servers/37f1ede5-bcf8-4698-8d27-b69d90fc3db4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:01:40.174869 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:40.175490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:40.182477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:40.182928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:40.183694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:40.184134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:40.553314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:40.561699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:40.563197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:40.564439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-67803318-cb1f-4a22-b92c-a74443d9980d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.393376 Jun 07 16:01:40.564938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 195/410] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:40 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:40.758487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:40.759177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:40.769513 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:40.770073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:40.770971 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:40.771415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:40.931339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:40.940394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-08b83ada-517c-4fe0-999e-2434280e6733 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.185953 Jun 07 16:01:40.941865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 216/411] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:40 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:41.583559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:41.584271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:41.591254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:41.591701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:41.592574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:41.593012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:41.750212 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:41.763934 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:41.766094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:41.766930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dd116dcc-7682-49fe-9273-5ea04daa5d3e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.187362 Jun 07 16:01:41.767699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 196/412] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:41 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:41.957995 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:41.958608 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:41.965196 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:41.965647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:41.966413 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:41.966850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:42.113203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:42.120874 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c6614320-b53e-4698-a037-f90a741b39de tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.167431 Jun 07 16:01:42.121446 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 217/413] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:41 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:42.785938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:42.786545 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:42.793055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:42.793503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:42.794260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:42.794694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:42.807699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-428df457-0c3e-485e-9fe3-c2be4fd46f48 req-9be5eeb8-942a-42fa-b9fd-c4ba8ec39eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "name": "network-vif-plugged", "status": "completed", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:01:42.816633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-428df457-0c3e-485e-9fe3-c2be4fd46f48 req-9be5eeb8-942a-42fa-b9fd-c4ba8ec39eba service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:42.817877 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-428df457-0c3e-485e-9fe3-c2be4fd46f48 req-9be5eeb8-942a-42fa-b9fd-c4ba8ec39eba service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:42.831028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-428df457-0c3e-485e-9fe3-c2be4fd46f48 req-9be5eeb8-942a-42fa-b9fd-c4ba8ec39eba service nova] Creating event network-vif-plugged:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 16:01:42.836688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-428df457-0c3e-485e-9fe3-c2be4fd46f48 req-9be5eeb8-942a-42fa-b9fd-c4ba8ec39eba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Jun 07 16:01:42.837616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 218/414] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:01:42.953266 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:42.962331 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:42.963850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:42.965061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d5f8a6b9-6272-4151-a7c7-16a716ee4416 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.183429 Jun 07 16:01:42.965621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 197/415] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:42 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:43.139373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:43.140061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:43.146756 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:43.147296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:43.148130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:43.148656 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:43.279030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:43.287365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a0a25973-cd54-48de-9b75-095e59f6e635 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.152659 Jun 07 16:01:43.287928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 219/416] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:43 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:43.984635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:43.985366 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:43.993685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:43.994134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:43.994902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:43.995370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:44.138124 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:44.148780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:44.150504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:44.152323 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-abc1883e-e4ee-4024-a555-c3bfb5b9e2a5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.171537 Jun 07 16:01:44.152939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 198/417] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:43 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:44.304529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:44.305055 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:44.311532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:44.311987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:44.312775 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:44.313214 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:44.446973 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:44.454388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-07f8d0fb-aa57-419d-9f1b-75a70dd64dc0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.153995 Jun 07 16:01:44.454948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 220/418] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:44 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:45.173767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:45.174427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:45.177420 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=80 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:45.182838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:45.183275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:45.184027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:45.184495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:45.310476 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:45.319562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:45.321086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:45.322232 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ba76e66e-e004-4c6b-b6f9-a47b775a404c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1807 microversion: 2.20 time: 0.152747 Jun 07 16:01:45.322785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 199/419] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:45 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:45.471340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:45.471876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:45.479149 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:45.479598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:45.480633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:45.481069 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:45.499812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:45.620816 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:45.628177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-511a67be-b9f3-419e-b36c-5636849a3e8b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.160968 Jun 07 16:01:45.629103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 221/420] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:45 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:46.341672 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:46.343312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:46.352667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:46.353120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:46.353884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:46.354318 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:46.571447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:46.579931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:46.581494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:46.582645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8187a3a8-f113-4e48-8129-d220c22ce7c6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1794 microversion: 2.20 time: 0.245012 Jun 07 16:01:46.583898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 200/421] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:01:46 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1794 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:01:46.644339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:46.644971 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:46.652019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:46.652527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:46.653292 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:46.653730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:46.795225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:46.803341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0496f076-86e9-4547-8ef7-d822a1109f8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.162872 Jun 07 16:01:46.803897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 222/422] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:46 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:47.820204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:47.820764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:47.827259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:47.827708 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:47.828496 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:47.828933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:47.843284 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:47.961317 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:47.968711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1abef099-775b-445b-926e-976aa22eb191 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.152969 Jun 07 16:01:47.969280 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 201/423] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:47 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:48.985766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:48.986380 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:48.988867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:01:48.995046 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:48.995499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:48.996263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:48.996730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:49.126734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:49.134797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-775c7ce5-abb9-44d7-994d-3d5440f13adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.152932 Jun 07 16:01:49.135368 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 223/424] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:48 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:50.150777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:50.151502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:50.157963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:50.158411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:50.159165 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:50.159595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:50.289415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:50.296914 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-efa01358-9fbe-418e-b35d-ce21a0971f82 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.150042 Jun 07 16:01:50.297484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 202/425] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:50 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:51.314352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:51.314961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:51.321557 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:51.322009 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:51.322766 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:51.323200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:51.448412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:51.455820 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2b7ea6ad-0274-4408-87d5-7f2f55c53dcd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.145341 Jun 07 16:01:51.456403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 224/426] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:51 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:52.473085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:52.474494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:52.481369 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:52.481812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:52.482559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:52.482985 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:52.610150 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:52.618182 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-10c25066-0f2b-4f09-b8c6-fd177fcc9cbc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.148899 Jun 07 16:01:52.618731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 203/427] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:52 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:53.635573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:53.636191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:53.642891 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:53.643344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:53.644106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:53.644593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:53.775829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:53.783174 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5338a214-e126-423d-9ea7-d4a977fd465a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.151428 Jun 07 16:01:53.783732 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 225/428] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:53 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:54.798994 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:54.799599 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:54.806711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:54.807156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:54.807900 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:54.808333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:54.936272 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:54.944535 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-98d3b40a-9e87-4fa7-8025-4e2f79bdfa51 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.149333 Jun 07 16:01:54.945107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 204/429] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:54 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:55.961872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:55.962404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:55.968898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:55.969347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:55.970095 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:55.970528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:56.101401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:56.109115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-78b1aa96-f892-4dc2-92a6-519561a67522 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.152160 Jun 07 16:01:56.109696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 226/430] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:55 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:57.125393 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:57.125993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:57.132666 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:57.133110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:57.133858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:57.134286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:57.263658 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:57.271969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-64528284-1fc2-4cdf-a21b-d48e7cca0fac tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.150314 Jun 07 16:01:57.272567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 205/431] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:57 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:58.289354 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:58.289964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:58.296316 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:58.296787 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:58.297547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:58.297978 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:58.426784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:58.434250 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-aa159810-af7f-4f8c-94b7-801cb8364b16 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.149354 Jun 07 16:01:58.434874 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 227/432] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:58 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:01:59.451363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:01:59.451979 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:01:59.458431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:59.458930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:59.459788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:01:59.460216 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:01:59.588133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:01:59.595585 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-612d3027-60b6-4b14-9739-7f57670646ce tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.148122 Jun 07 16:01:59.596146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 206/433] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:01:59 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:00.613729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:00.614267 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:00.621502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:00.621953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:00.622704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:00.623138 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:00.762010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:00.769460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6558f9d7-d4b3-489a-b07f-d1b4cbc6ae99 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.159686 Jun 07 16:02:00.770049 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 228/434] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:00 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:01.786306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:01.787148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:01.794560 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.795004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:01.795775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.796204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:01.921481 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:01.928973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-252a9073-489a-488d-9fe5-c6d9b985959f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1502 microversion: 2.1 time: 0.146516 Jun 07 16:02:01.929543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 207/435] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:01 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:01.946227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af6a4f21-a96a-4930-a5cb-ed8919aad589"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:01.947277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:01.953737 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.954176 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:01.954920 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.955344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:01.977981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] HTTP exception thrown: Cannot 'attach_volume' instance 3def1191-4ee0-45d7-b43f-2e16de89e478 while it is in vm_state rescued Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Request method failure captured: Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/os-volume_attachments HTTP/1.1 Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 74 Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3YB9jh1gsMMPbVQTbCCB5Izz7_yiT_tPNoot629O01IoH3v8Bh8YJxGDBUJ28g2gsesMcPhYLvwc9Vwm6pT1Uo2z4VMc8ymnTlTRGlK5bgpU3gPqqpaLeWHrwoRwZp-GvLvxnWlL22lcoR5e5K3BzRJS1tZk9YgfFkbNs1XtX1ps_A Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:02:01.979661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_960d9a6b1f514344aa82bbada2b878ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: e9ca987fc23d4ff1a88dd4ed7b38980c Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {"volumeAttachment": {"volumeId": "af6a4f21-a96a-4930-a5cb-ed8919aad589"}} Jun 07 16:02:01.981330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Cannot 'attach_volume' instance 3def1191-4ee0-45d7-b43f-2e16de89e478 while it is in vm_state rescued Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'server_id': '3def1191-4ee0-45d7-b43f-2e16de89e478', 'body': {'volumeAttachment': {'volumeId': 'af6a4f21-a96a-4930-a5cb-ed8919aad589'}}} Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:02:01.982103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3def1191-4ee0-45d7-b43f-2e16de89e478 while it is in vm_state rescued Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:01.983160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3def1191-4ee0-45d7-b43f-2e16de89e478 while it is in vm_state rescued Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Returning 409 to user: Cannot 'attach_volume' instance 3def1191-4ee0-45d7-b43f-2e16de89e478 while it is in vm_state rescued {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a28caf49-8971-4393-a229-1f44bf05e7d0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039697 Jun 07 16:02:01.984404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 229/436] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:02:01 2022] POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 16:02:01.990405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:01.990928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:01.996785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.997229 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:01.997976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:01.998407 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:02.062552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4a030342-769c-4c43-8a39-f927cd25f134 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/action" status: 202 len: 0 microversion: 2.1 time: 0.075992 Jun 07 16:02:02.063095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 208/437] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:02:01 2022] POST /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:02.071651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:02.072260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:02.078321 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:02.078765 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:02.079520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:02.079949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:02.293246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:02.300689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-15e9d43b-2bf9-40c9-8332-a27f2ad24714 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1510 microversion: 2.1 time: 0.233294 Jun 07 16:02:02.301263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 230/438] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:02 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:03.318014 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:03.318886 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:03.325052 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:03.325494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:03.326236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:03.326663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:03.458964 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:03.467041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b1068d99-f912-4102-bf8d-6c735c4907a0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1510 microversion: 2.1 time: 0.153801 Jun 07 16:02:03.467599 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 209/439] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:03 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:04.485597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:04.486767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:04.493926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:04.494365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:04.495113 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:04.495562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:04.621443 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:04.628767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5ad145c2-b2c0-4344-8998-3df5d280d773 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1510 microversion: 2.1 time: 0.147058 Jun 07 16:02:04.629359 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 231/440] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:04 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:05.645859 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:05.646480 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:05.653661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:05.654109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:05.654879 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:05.655315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:05.790265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:05.797745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-688412e6-643c-4315-a04f-9571a79ac9a4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1516 microversion: 2.1 time: 0.155751 Jun 07 16:02:05.798313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 210/441] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:05 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:06.911628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:06.912191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:06.919223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:06.919675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:06.920467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:06.920908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:07.045714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lazy-loading 'services' on Instance uuid 7bdb18ec-9446-430f-a00e-92e1c847f165 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:07.128517 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dfb655cd-cb1f-4cbf-9553-57f0ffe05b8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: .version_select at 0x7f14485ca9d0>, body: {"keypair": {"name": "tempest-keypair-2077424140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd7HWZjd4xwz2pK5fdDAz8gCsAcmnTKlAGRbgR/TR411adqCgsFedzXRux2hio9jGeUwjPEFJs7wbjuZy8b3ynLmXpS2WkDWt0Q2GBChk2i3+9/aJZc2IrSN/WxaJpg1w=="}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:07.144749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-dfb655cd-cb1f-4cbf-9553-57f0ffe05b8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:07.149898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-dfb655cd-cb1f-4cbf-9553-57f0ffe05b8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for user e9ca987fc23d4ff1a88dd4ed7b38980c and project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:07.163002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-419b4ecd-083e-4941-90cc-f5e8d98aaf56 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments/2a5dfce3-35a3-4e23-b5df-f450a5641dbf" status: 202 len: 0 microversion: 2.1 time: 0.254376 Jun 07 16:02:07.163674 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 232/442] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:02:06 2022] DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments/2a5dfce3-35a3-4e23-b5df-f450a5641dbf => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:07.176008 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dfb655cd-cb1f-4cbf-9553-57f0ffe05b8e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051172 Jun 07 16:02:07.177113 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 211/443] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:02:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:02:08.277541 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ffb3e2f7-ccec-4da8-bd58-097d779298ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:08.283930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2f7-ccec-4da8-bd58-097d779298ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:08.284494 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2f7-ccec-4da8-bd58-097d779298ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:08.307441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ffb3e2f7-ccec-4da8-bd58-097d779298ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Going to try to stop instance {{(pid=117818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 16:02:08.352344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ffb3e2f7-ccec-4da8-bd58-097d779298ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action" status: 202 len: 0 microversion: 2.1 time: 0.079169 Jun 07 16:02:08.353388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 233/444] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:02:08 2022] POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:08.361469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:08.362078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:08.368787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:08.369258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:08.370315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:08.370963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:08.517742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:08.525667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9657bbb2-13b8-4d26-8114-0246dd1d352e tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.168158 Jun 07 16:02:08.526322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 212/445] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:08 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:08.550795 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-948246525", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80297557-5fee-443b-89c5-3ebd07d39a51"}], "security_groups": [{"name": "tempest-securitygroup--324536694"}], "key_name": "tempest-keypair-2077424140", "user_data": "}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:08.651678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] validate_networks() for [('80297557-5fee-443b-89c5-3ebd07d39a51', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:02:09.014640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:02:09.015132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:02:09.015667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:02:09.016129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:02:09.016527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:02:09.026037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:09.026484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:09.027338 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:09.027826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:09.044951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:09.048906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Getting quotas for user e9ca987fc23d4ff1a88dd4ed7b38980c and project 960d9a6b1f514344aa82bbada2b878ca. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:09.060006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:02:09.062371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:02:09.110035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9db4adc7-e0a9-476a-99b7-fa29f2da48e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.563812 Jun 07 16:02:09.110681 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 234/446] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:02:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:02:09.120673 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3b9c6860-6ebd-46eb-abd2-4dd06c5e39f4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:09.121287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3b9c6860-6ebd-46eb-abd2-4dd06c5e39f4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:09.179552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3b9c6860-6ebd-46eb-abd2-4dd06c5e39f4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:09.187155 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3b9c6860-6ebd-46eb-abd2-4dd06c5e39f4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1245 microversion: 2.1 time: 0.070374 Jun 07 16:02:09.187732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 213/447] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:09 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:09.545084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:09.545700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:09.552944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:09.553617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:09.554703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:09.555227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:09.691989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:09.700603 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4fe3de8b-648e-4d16-ad1d-acab1d23b9b5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.159935 Jun 07 16:02:09.701176 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 235/448] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:09 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:10.204424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:10.205016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.211778 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.212220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.212995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.213426 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.276833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:10.284127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-62bf3fa3-e509-4e88-ab90-1a87f1617332 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1297 microversion: 2.1 time: 0.083530 Jun 07 16:02:10.284721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 214/449] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:10 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:10.415087 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:10.415508 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.421627 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.422077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.422835 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.423268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.447470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-46d78cfd-f94c-4d17-8e63-be971f3b4fea tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/ips" status: 200 len: 147 microversion: 2.1 time: 0.037198 Jun 07 16:02:10.448058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 236/450] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:02:10 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:10.459959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e517e94-2f36-4b7e-a6df-0a8402f165d5"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:10.461177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.467902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.468375 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.469182 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.469625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.562146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: POST /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/os-volume_attachments HTTP/1.1 Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 74 Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:02:10.564099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {"volumeAttachment": {"volumeId": "4e517e94-2f36-4b7e-a6df-0a8402f165d5"}} Jun 07 16:02:10.565532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'server_id': '816146bc-5797-4984-a957-b06cd866439d', 'body': {'volumeAttachment': {'volumeId': '4e517e94-2f36-4b7e-a6df-0a8402f165d5'}}} Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:10.566421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:10.567905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:10.570475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 400 to user: Invalid volume: volume 4e517e94-2f36-4b7e-a6df-0a8402f165d5 is already attached to instances: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:02:10.571275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-48858b21-6916-4378-875b-794e37a83c25 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115669 Jun 07 16:02:10.575150 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 215/451] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:02:10 2022] POST /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:02:10.582276 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:10.582810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.590281 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.590756 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.591566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.591998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.622191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:02:10.625195 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:10.702058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-beaa08fb-1828-464c-88d7-4a9a0aac79ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 204 len: 0 microversion: 2.1 time: 0.125253 Jun 07 16:02:10.702667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 237/452] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:02:10 2022] DELETE /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:02:10.710674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:10.711283 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.718334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.718516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:10.718774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.719207 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:10.720037 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.720718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.726982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.726982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:10.727275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:10.727497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:11.009211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:11.015039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:11.017911 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-914e5ccc-a2c3-4eb0-b897-3e9227ea9110 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.303552 Jun 07 16:02:11.018582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 238/453] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:10 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:11.023483 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c01b0dd4-6991-451e-a653-8e90ad9f378c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1679 microversion: 2.1 time: 0.316561 Jun 07 16:02:11.024051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 216/454] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:10 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1679 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:11.304021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:11.305354 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:11.311485 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:11.311934 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:11.312742 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:11.313185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:11.452188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:11.459754 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3ba0fb86-58cc-4a24-a6d4-d931ca287d9a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.160616 Jun 07 16:02:11.460247 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 239/455] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:11 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:12.035005 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:12.035617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:12.041731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:12.042340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:12.042760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.043211 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.043978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.044460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.048716 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.049161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.049940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.050388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.296729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:12.302254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:12.305259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4ff7de90-2cb9-4c23-af95-38a528f540e8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1679 microversion: 2.1 time: 0.268265 Jun 07 16:02:12.305847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 240/456] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:12 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:12.310838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d676f100-07d9-4a6e-80b0-6fdb12e6faf4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.279683 Jun 07 16:02:12.311714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 217/457] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:12 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:12.477228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:12.477956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:12.484437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.484889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.485669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:12.486106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:12.886094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:12.894556 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e8c04593-bcd0-4d14-8b8e-c858debd6c35 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.421663 Jun 07 16:02:12.895152 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 241/458] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:12 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:13.330121 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:13.331397 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:13.341932 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.342387 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.344704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:13.345323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:13.351552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.352050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.357804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.358262 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.359052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.359488 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.713673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:13.721187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f3895f9b-38c2-42a5-a399-d18a3b3f3b10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.384776 Jun 07 16:02:13.722142 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 242/459] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:13 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:13.733947 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:13.742726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-696736da-45b6-433e-8577-310705f93035 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1679 microversion: 2.1 time: 0.416749 Jun 07 16:02:13.743388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 218/460] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:13 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1679 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:13.914426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:13.915153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:13.922743 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-73b20b14-c96a-41b9-ab5c-84e54284b73b req-bfd7032a-ea62-44ee-9316-3bcefb2f1b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:13.935512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.938184 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-73b20b14-c96a-41b9-ab5c-84e54284b73b req-bfd7032a-ea62-44ee-9316-3bcefb2f1b75 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.939349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-73b20b14-c96a-41b9-ab5c-84e54284b73b req-bfd7032a-ea62-44ee-9316-3bcefb2f1b75 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.940192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.942064 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:13.943061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:13.946432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:13.968824 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-73b20b14-c96a-41b9-ab5c-84e54284b73b req-bfd7032a-ea62-44ee-9316-3bcefb2f1b75 service nova] Creating event network-changed:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:02:13.974241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-73b20b14-c96a-41b9-ab5c-84e54284b73b req-bfd7032a-ea62-44ee-9316-3bcefb2f1b75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055087 Jun 07 16:02:13.976204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 219/461] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:14.236550 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:14.246105 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3d92c270-985e-4f03-bf5e-f188b9ac3d39 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.338577 Jun 07 16:02:14.254001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 243/462] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:13 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:14.739478 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:14.740082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:14.749293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:14.749744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:14.750505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:14.750937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:14.761355 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:14.761965 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:14.781968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:14.782410 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:14.783186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:14.783621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:14.827160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:14.827847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:14.829146 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'fault' on Instance uuid 816146bc-5797-4984-a957-b06cd866439d {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:14.903880 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:14.913074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c96cf65c-afa7-4a53-bdf8-adcb99745f9c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 200 len: 1331 microversion: 2.1 time: 0.154609 Jun 07 16:02:14.913924 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 244/463] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:14 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:14.974118 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:14.982893 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-506e29b5-2b11-4b26-9245-b56e3a47830b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.247652 Jun 07 16:02:14.983473 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 220/464] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:14 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:15.263749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:15.264619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:15.272536 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:15.273002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:15.273792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:15.274954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:15.413815 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:15.421773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cdd1fb76-11ea-4cae-8bc8-ee2c183bcd5f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.161731 Jun 07 16:02:15.422350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 245/465] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:15 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:15.932778 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:15.934135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:15.940770 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:15.946065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:15.946777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:15.947627 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:15.947992 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:15.964346 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d HTTP/1.1 Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:02:15.966043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:02:15.967319 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '816146bc-5797-4984-a957-b06cd866439d'} Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:02:15.968047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:02:15.969296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:15.970432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:02:15.970432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e42fce77-a83e-4932-bec4-c6812917a419 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 404 len: 111 microversion: 2.1 time: 0.041226 Jun 07 16:02:15.971344 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 221/466] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:15 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:02:15.976521 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4006798a-6e9e-466e-8380-5529beeec98b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '.version_select at 0x7f14484e91f0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:15.994510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-1398008c-a480-4751-82bb-f9b4174ec4b7 req-e2579f8e-ced2-46e0-a397-0d3254925ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "816146bc-5797-4984-a957-b06cd866439d", "name": "network-vif-deleted", "tag": "6e57fb6c-90ee-4906-85c3-42d6621fc544"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:15.997203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4006798a-6e9e-466e-8380-5529beeec98b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335057143" status: 202 len: 0 microversion: 2.1 time: 0.024739 Jun 07 16:02:15.997941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 246/467] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 7 16:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335057143 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:16.004410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-1398008c-a480-4751-82bb-f9b4174ec4b7 req-e2579f8e-ced2-46e0-a397-0d3254925ee7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.005170 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:16.005300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-1398008c-a480-4751-82bb-f9b4174ec4b7 req-e2579f8e-ced2-46e0-a397-0d3254925ee7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.006301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:16.019105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-1398008c-a480-4751-82bb-f9b4174ec4b7 req-e2579f8e-ced2-46e0-a397-0d3254925ee7 service nova] Creating event network-vif-deleted:6e57fb6c-90ee-4906-85c3-42d6621fc544 for instance 816146bc-5797-4984-a957-b06cd866439d on hv-cinder-84487 Jun 07 16:02:16.025795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-1398008c-a480-4751-82bb-f9b4174ec4b7 req-e2579f8e-ced2-46e0-a397-0d3254925ee7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037831 Jun 07 16:02:16.027004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 222/468] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:02:16.027972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.028446 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.029667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.030260 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.439660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:16.440403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:16.448584 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.448930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.449685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.450127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.570894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:16.580891 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6cdc1873-cf48-4221-b5f5-3682e2f5377b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.579182 Jun 07 16:02:16.581773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 247/469] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:15 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:16.727301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:16.735902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1ed2b057-4d36-40af-8d59-addd6cd1f300 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.300041 Jun 07 16:02:16.737964 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 223/470] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:16 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:16.845497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:16.846168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:16.852623 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.853341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.854172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:16.854812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:16.939539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'services' on Instance uuid 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:17.015015 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-00b21553-2071-4ad1-922f-fc7ba104b138 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments/4e517e94-2f36-4b7e-a6df-0a8402f165d5" status: 202 len: 0 microversion: 2.1 time: 0.173276 Jun 07 16:02:17.015629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 248/471] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:02:16 2022] DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments/4e517e94-2f36-4b7e-a6df-0a8402f165d5 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:17.024632 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:17.025618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:17.032021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.032648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.033647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.034135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.064461 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b2924c64-7a9a-4c72-8677-27653f17d7f7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Jun 07 16:02:17.064845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 224/472] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:02:17 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:17.603019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:17.603663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:17.610599 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.611043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.611984 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.612455 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.748639 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:17.753071 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:17.753691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:17.756391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5dd4b150-4968-417b-b17b-5740d0b168f7 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.160092 Jun 07 16:02:17.757179 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 249/473] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:17 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:17.760589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.761034 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.761784 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:17.762213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:17.897534 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:17.906154 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-54ad81d2-eb5c-4263-b0c3-499117546673 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.156792 Jun 07 16:02:17.906721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 225/474] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:17 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:18.076799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:18.077687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:18.084721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.085386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.086138 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.086570 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.115020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-71858e63-13f7-4988-b1db-a52d5215c47d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042318 Jun 07 16:02:18.115869 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 250/475] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:02:18 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:02:18.177565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:18.178206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:18.185077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.185519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.186270 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.186697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.213089 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:02:18.285654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a6057c82-224f-472b-9641-17b88d93ba9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 204 len: 0 microversion: 2.1 time: 0.112330 Jun 07 16:02:18.286460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 226/476] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:02:18 2022] DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 16:02:18.294897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:18.295525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:18.301523 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.301975 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.302764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.303210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.434014 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:18.441499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d63225a8-a0ca-4340-8ed2-6b4abeb56845 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1681 microversion: 2.1 time: 0.150713 Jun 07 16:02:18.442070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 251/477] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:18 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:18.774020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:18.774826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:18.780923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.781366 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.782113 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.782541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.913839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:18.922305 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7698e9bf-3530-4d6b-9c84-e468901e80a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1676 microversion: 2.1 time: 0.152415 Jun 07 16:02:18.922754 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:18.932641 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 227/478] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:18 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:18.932947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:18.932947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.932947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:18.932947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:18.933307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:19.035702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:19.055756 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:19.069860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:19.073226 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:19.078239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b623824b-1069-4b6c-9180-ec717a2097b9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.159178 Jun 07 16:02:19.078839 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 252/479] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:18 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:19.459650 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:19.460666 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:19.463135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:19.468558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:19.469004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:19.469765 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:19.470198 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:19.602368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:19.610162 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-31c21d82-ddc7-4f0e-87b5-1bbcfd4864cf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1681 microversion: 2.1 time: 0.155167 Jun 07 16:02:19.610729 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 228/480] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:19 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:19.942286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:19.942906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:19.946500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:19.953576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:19.954049 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:19.954798 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:19.955245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.094967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:20.095607 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:20.101947 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.102388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.103143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.103574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.187145 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:20.196872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-676dd6fb-aae0-4202-8821-b18d060baee5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1653 microversion: 2.1 time: 0.258537 Jun 07 16:02:20.197469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 253/481] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:19 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1653 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:20.213990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7228ccf3-a4b2-465f-a5eb-42227d4bb74b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:20.220309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7228ccf3-a4b2-465f-a5eb-42227d4bb74b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.220788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7228ccf3-a4b2-465f-a5eb-42227d4bb74b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.244111 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7228ccf3-a4b2-465f-a5eb-42227d4bb74b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Going to try to start instance {{(pid=117818) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 16:02:20.289539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7228ccf3-a4b2-465f-a5eb-42227d4bb74b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action" status: 202 len: 0 microversion: 2.1 time: 0.079313 Jun 07 16:02:20.290612 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 254/482] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:02:20 2022] POST /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:02:20.300126 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:20.300902 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:20.309841 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.310063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.310794 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.311274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.346381 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:20.354707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3aaa26fa-93fa-4b49-aaa0-6490d81464dc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.263627 Jun 07 16:02:20.355544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 229/483] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:20 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:20.627702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:20.629219 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:20.630022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:20.636389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0ebbf224-3400-4a22-84a8-5df920680ea2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1662 microversion: 2.1 time: 0.341553 Jun 07 16:02:20.637195 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.637331 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 255/484] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:20 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1662 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:20.637412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.638292 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.638731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:20.914701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:20.923986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1842e9c8-470f-44a1-a2ea-767bb6e63eac tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1681 microversion: 2.1 time: 0.300460 Jun 07 16:02:20.924780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 230/485] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:20 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:20.987575 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-a39eaf7c-3a2b-4e87-b225-d7096cc0529b req-9096a8f6-5652-415a-a65f-193b3f68fb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "name": "network-vif-plugged", "status": "completed", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:20.997491 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-a39eaf7c-3a2b-4e87-b225-d7096cc0529b req-9096a8f6-5652-415a-a65f-193b3f68fb6f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:20.997936 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-a39eaf7c-3a2b-4e87-b225-d7096cc0529b req-9096a8f6-5652-415a-a65f-193b3f68fb6f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.010114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-a39eaf7c-3a2b-4e87-b225-d7096cc0529b req-9096a8f6-5652-415a-a65f-193b3f68fb6f service nova] Creating event network-vif-plugged:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:02:21.014889 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-a39eaf7c-3a2b-4e87-b225-d7096cc0529b req-9096a8f6-5652-415a-a65f-193b3f68fb6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Jun 07 16:02:21.015655 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 256/486] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:21.371563 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:21.372178 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:21.378225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.378674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.379454 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.379887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.643265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:21.663243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:21.665130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:21.667879 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dfc9b666-7f79-4022-a2ea-4ed3e4bd8914 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.300035 Jun 07 16:02:21.669918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 231/487] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:21 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:21.686820 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.687272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.688049 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.688547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.715618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-d736022a-cf17-4a03-8b57-872d9d039db5 req-eb813005-ea7c-46e5-9b3f-867b4fa5c89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9edf7214-7bd8-479d-8d1b-1b8df84e7a0b", "name": "network-vif-deleted", "tag": "4208b596-39fa-4701-8fbb-e471f3af4e3d"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:21.733075 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d736022a-cf17-4a03-8b57-872d9d039db5 req-eb813005-ea7c-46e5-9b3f-867b4fa5c89b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.733519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d736022a-cf17-4a03-8b57-872d9d039db5 req-eb813005-ea7c-46e5-9b3f-867b4fa5c89b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.749729 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d736022a-cf17-4a03-8b57-872d9d039db5 req-eb813005-ea7c-46e5-9b3f-867b4fa5c89b service nova] Creating event network-vif-deleted:4208b596-39fa-4701-8fbb-e471f3af4e3d for instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b on hv-cinder-84487 Jun 07 16:02:21.754969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-d736022a-cf17-4a03-8b57-872d9d039db5 req-eb813005-ea7c-46e5-9b3f-867b4fa5c89b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043985 Jun 07 16:02:21.755605 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 232/488] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:02:21.836220 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:21.845043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f78a989f-0631-4a44-8253-8e6977cfdb9b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1662 microversion: 2.1 time: 0.194837 Jun 07 16:02:21.845900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 257/489] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:21 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1662 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:21.942412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:21.943740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:21.950271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.950712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.951465 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.951891 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.983733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:21.984184 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:21.984647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'fault' on Instance uuid 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:22.027121 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:22.034705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-883b4deb-6f2f-44ef-baa0-669206be4e66 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1332 microversion: 2.1 time: 0.097090 Jun 07 16:02:22.035280 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 233/490] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:21 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:22.685885 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:22.686502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:22.693462 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:22.693705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:22.694357 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:22.694796 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:22.835193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:22.843136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-94a9be4e-e687-4e97-af8f-0af52bd8bd8a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1370 microversion: 2.1 time: 0.161110 Jun 07 16:02:22.844433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 258/491] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:22 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:22.866641 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:22.868243 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:22.874615 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:22.875057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:22.875806 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:22.876233 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.008012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:23.015415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8235324c-e0de-4c18-a248-32bed4b31416 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1666 microversion: 2.1 time: 0.154963 Jun 07 16:02:23.015980 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 234/492] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:22 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:23.051471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:23.052089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:23.058267 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:23.058721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.059507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:23.059949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.091835 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:23.092285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.092767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'fault' on Instance uuid 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:23.133543 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:23.141143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c86d087d-186f-409b-b977-15bbfd1471a7 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 200 len: 1332 microversion: 2.1 time: 0.093563 Jun 07 16:02:23.141719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 259/493] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:23 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:23.861333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:23.862078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:23.868676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:23.869283 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.869871 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:23.870308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:23.999000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:24.006427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-174a7827-4a4c-42e9-81ef-20c7f49b3ebd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1564 microversion: 2.1 time: 0.149055 Jun 07 16:02:24.006995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 235/494] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:23 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:24.023069 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:24.023590 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:24.030040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:24.030738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:24.031505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:24.031950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:24.110485 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0f437b28-010f-4211-b49f-38a99b935f27 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091174 Jun 07 16:02:24.111079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 260/495] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:02:24 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:24.158650 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:24.159298 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:24.166201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:24.166660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:24.167428 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:24.167866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:24.184946 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b HTTP/1.1 Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:02:24.187252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:02:24.188709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '9edf7214-7bd8-479d-8d1b-1b8df84e7a0b'} Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:02:24.189510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:02:24.190649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:24.191725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:02:24.191725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3f9f8cba-b091-47c9-9912-61079ca25b96 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 404 len: 111 microversion: 2.1 time: 0.034127 Jun 07 16:02:24.191725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 236/496] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:24 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:02:24.198050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4dcf37de-afc1-4bc1-968a-13292340d70b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '.version_select at 0x7f1448645430>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:24.215561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4dcf37de-afc1-4bc1-968a-13292340d70b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240648331" status: 202 len: 0 microversion: 2.1 time: 0.021619 Jun 07 16:02:24.216139 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 261/497] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 7 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240648331 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 16:02:25.019394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-72da10e7-9cb3-4fc6-9f04-c9fc5247787c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: .version_select at 0x7f144857c790>, body: {"keypair": {"name": "tempest-keypair-2021422276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD746WRfvanuH1QmUAkoGwvJrEVQmZ1bDeJEOQ/ZjepUdKj65nch1d1nR9S2b0kbKeC9+g9/5gZoMIgkGKK0Y/rjQw6CbnZM0Gyum8QbNDbIdYH496Wmhnk2Wejzmtjpw=="}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:25.035024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-72da10e7-9cb3-4fc6-9f04-c9fc5247787c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:25.039120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-72da10e7-9cb3-4fc6-9f04-c9fc5247787c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:25.061013 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-72da10e7-9cb3-4fc6-9f04-c9fc5247787c tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045560 Jun 07 16:02:25.061826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 237/498] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:02:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:25.359930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-d8106af6-710d-4b9b-a565-a27742f99ced req-18b3c3b3-4869-45af-96ce-2fa9cda1d7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:25.369296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-d8106af6-710d-4b9b-a565-a27742f99ced req-18b3c3b3-4869-45af-96ce-2fa9cda1d7eb service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:25.370239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-d8106af6-710d-4b9b-a565-a27742f99ced req-18b3c3b3-4869-45af-96ce-2fa9cda1d7eb service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:25.384463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-d8106af6-710d-4b9b-a565-a27742f99ced req-18b3c3b3-4869-45af-96ce-2fa9cda1d7eb service nova] Creating event network-changed:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:02:25.389654 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-d8106af6-710d-4b9b-a565-a27742f99ced req-18b3c3b3-4869-45af-96ce-2fa9cda1d7eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034517 Jun 07 16:02:25.390428 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 262/499] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:26.525287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-578033090", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c78cec0-a2d6-49be-a908-94b7edf4c82d"}], "security_groups": [{"name": "tempest-securitygroup--226190838"}], "key_name": "tempest-keypair-2021422276", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:26.627570 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] validate_networks() for [('5c78cec0-a2d6-49be-a908-94b7edf4c82d', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:02:26.983548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:02:26.983948 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:02:26.984448 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:02:26.984858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:02:26.985267 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:02:26.994213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:26.994657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:26.995444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:26.995875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:27.002503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:27.015621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:27.019541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:27.031429 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:02:27.033750 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:02:27.081773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-64b5b15d-90a3-4d23-9e8c-796b1da1d721 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560778 Jun 07 16:02:27.082413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 238/500] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:02:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:02:27.093549 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-94ceca23-76b5-40bd-8464-67d91f841fc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:27.094263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-94ceca23-76b5-40bd-8464-67d91f841fc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:27.154784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-94ceca23-76b5-40bd-8464-67d91f841fc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:27.161532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-94ceca23-76b5-40bd-8464-67d91f841fc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1241 microversion: 2.1 time: 0.072119 Jun 07 16:02:27.162102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 263/501] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:27 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:28.178533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:28.179176 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:28.185892 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.186300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:28.187224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.187670 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:28.256499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:28.264589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-85d57c2d-710a-465b-9071-b632472c2367 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1299 microversion: 2.1 time: 0.090544 Jun 07 16:02:28.265154 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 239/502] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:28 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:28.812684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:28.813208 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:28.820294 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.820970 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:28.821744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.822172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:28.856923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e6e78a8c-3dee-4f4a-9545-08229907418e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments/981ba9ca-9b94-4019-972d-2a5a64469129" status: 200 len: 194 microversion: 2.20 time: 0.049275 Jun 07 16:02:28.857531 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 264/503] 10.222.0.18 () {60 vars in 1453 bytes} [Tue Jun 7 16:02:28 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments/981ba9ca-9b94-4019-972d-2a5a64469129 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 16:02:28.930492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:28.930986 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:28.937104 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.938177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:28.938947 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:28.939677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.068049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lazy-loading 'services' on Instance uuid a6d85f31-64e0-469b-ab5d-bb1534dc3889 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:02:29.184657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1884f1e4-7d2c-45e1-a4d1-c52d97e6820a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments/981ba9ca-9b94-4019-972d-2a5a64469129" status: 202 len: 0 microversion: 2.20 time: 0.259081 Jun 07 16:02:29.185371 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 240/504] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Jun 7 16:02:28 2022] DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments/981ba9ca-9b94-4019-972d-2a5a64469129 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:02:29.194251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:29.196303 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:29.202813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:29.203264 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.204065 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:29.204567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.235979 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5c7a67da-c6aa-4050-910f-a8bee8169a0e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046357 Jun 07 16:02:29.236577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 265/505] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 7 16:02:29 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 16:02:29.282113 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:29.282991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:29.290435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:29.291228 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.292540 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:29.292983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.503988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:29.511735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2856635b-86f3-4ecb-82ea-86239f3c0ddc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.234286 Jun 07 16:02:29.512449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 241/506] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:29 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:29.609689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-21aeabd1-e924-4180-a7f6-aa4d45746455 req-a9596969-cf8b-4137-9590-d2a40e09b394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68445d53-da9e-442d-93b8-0e70c601457f", "tag": "9e4269dc-abca-4501-a92b-01c74411106c"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:29.619420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-21aeabd1-e924-4180-a7f6-aa4d45746455 req-a9596969-cf8b-4137-9590-d2a40e09b394 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:29.620118 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-21aeabd1-e924-4180-a7f6-aa4d45746455 req-a9596969-cf8b-4137-9590-d2a40e09b394 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:29.641647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-21aeabd1-e924-4180-a7f6-aa4d45746455 req-a9596969-cf8b-4137-9590-d2a40e09b394 service nova] Creating event network-changed:9e4269dc-abca-4501-a92b-01c74411106c for instance 68445d53-da9e-442d-93b8-0e70c601457f on hv-cinder-84487 Jun 07 16:02:29.647559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-21aeabd1-e924-4180-a7f6-aa4d45746455 req-a9596969-cf8b-4137-9590-d2a40e09b394 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042113 Jun 07 16:02:29.649440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 266/507] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:30.248012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:30.248947 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:30.255522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.255970 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.256762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.257733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.286907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6859c4c2-80e0-4671-928b-29f41b0ed760 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042960 Jun 07 16:02:30.287665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 242/508] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 7 16:02:30 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:30.349499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:30.350080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:30.357074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.357525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.358284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.358721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.383925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:02:30.463073 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cc3f80af-31a2-4b04-8499-e8342b3f9aad tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 204 len: 0 microversion: 2.20 time: 0.117524 Jun 07 16:02:30.463652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 267/509] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 7 16:02:30 2022] DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 16:02:30.471594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:30.472199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:30.478322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.478767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.479511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.479938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.529429 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:30.530031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:30.536002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.536481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.537232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:30.537663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:30.648711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:30.657092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:30.658818 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:30.659996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d0a1d52c-63b4-4823-84e4-6e89ec135650 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.192181 Jun 07 16:02:30.660581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 243/510] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:30 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:30.693170 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:30.701533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b10ab5f7-60ff-49c7-8016-c4086b38bdd8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.176397 Jun 07 16:02:30.702089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 268/511] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:30 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:31.678670 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:31.679628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:31.686158 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:31.686601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:31.687359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:31.687787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:31.718394 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:31.719018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:31.725547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:31.726063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:31.727037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:31.727477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:31.870484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:31.887918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:31.890586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:31.893077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c402a650-d658-4453-bcb8-b5c619305c9f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.217350 Jun 07 16:02:31.893921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 244/512] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:31 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:31.909460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:31.917055 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3d200bd8-aea4-4d25-a775-240b363a5883 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.202458 Jun 07 16:02:31.917625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 269/513] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:31 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:32.917598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:32.918218 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:32.925077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:32.925711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:32.926547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:32.926990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:32.933783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:32.934571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:32.941514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:32.941938 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:32.943047 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:32.943275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:33.126609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:33.130725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:33.134855 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:33.136325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:33.140883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:33.142126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2fad8427-16ba-4ac8-a5a3-6f4bf27ff01c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1722 microversion: 2.20 time: 0.229179 Jun 07 16:02:33.142758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 245/514] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:32 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:33.143060 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-73d1a5d7-ca08-404b-a815-efae6c33d2bf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.212857 Jun 07 16:02:33.144121 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 270/515] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:32 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:34.163040 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:34.164279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:34.164812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:34.165433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:34.171039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:34.171488 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:34.172262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:34.172511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:34.172717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:34.172965 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:34.173736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:34.174167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:34.297522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:34.305865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:34.307544 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:34.308917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-de5a7fab-00ef-4984-a5aa-9e2d6acdb147 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 200 len: 1654 microversion: 2.20 time: 0.148672 Jun 07 16:02:34.309448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 271/516] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:34 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:02:34.430824 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:34.432422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-96f5decd-abe1-4a8e-a012-5308afd1378a req-81b19883-48f8-45ac-840e-f68b075b48b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d85f31-64e0-469b-ab5d-bb1534dc3889", "name": "network-vif-deleted", "tag": "9b997521-b0f1-4473-8789-20e9f18a83df"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:34.440968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-96f5decd-abe1-4a8e-a012-5308afd1378a req-81b19883-48f8-45ac-840e-f68b075b48b1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:34.441558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-96f5decd-abe1-4a8e-a012-5308afd1378a req-81b19883-48f8-45ac-840e-f68b075b48b1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:34.452341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0cb75fad-f6a0-4530-88fa-193fc2dbe4ef tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.292418 Jun 07 16:02:34.455713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-96f5decd-abe1-4a8e-a012-5308afd1378a req-81b19883-48f8-45ac-840e-f68b075b48b1 service nova] Creating event network-vif-deleted:9b997521-b0f1-4473-8789-20e9f18a83df for instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 on hv-cinder-84487 Jun 07 16:02:34.462066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 246/517] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:34 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:34.465711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-96f5decd-abe1-4a8e-a012-5308afd1378a req-81b19883-48f8-45ac-840e-f68b075b48b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Jun 07 16:02:34.466722 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 272/518] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:35.327597 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:35.328206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:35.334696 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:35.335145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:35.335902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:35.336553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:35.350593 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 HTTP/1.1 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:02:35.352767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:02:35.354471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'a6d85f31-64e0-469b-ab5d-bb1534dc3889'} Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:02:35.355314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:02:35.357185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:02:35.358421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:02:35.358421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1d827694-2e26-4f74-8257-8bca240a8372 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 404 len: 111 microversion: 2.20 time: 0.030531 Jun 07 16:02:35.358421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 247/519] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:35 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:02:35.364135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cb4c626f-4cc7-424a-b8dc-d109caeb58b8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '.version_select at 0x7f1448374160>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:35.390124 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cb4c626f-4cc7-424a-b8dc-d109caeb58b8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520162459" status: 204 len: 0 microversion: 2.20 time: 0.029567 Jun 07 16:02:35.390724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 273/520] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Jun 7 16:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520162459 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 16:02:35.470368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:35.471240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:35.478105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:35.478556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:35.479315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:35.479919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:35.629955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:35.638048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-86d720e8-b579-4cf8-b588-2c2c431691e3 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.171591 Jun 07 16:02:35.638621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 248/521] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:35 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:36.033850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2375250d-6920-4b43-8037-01efd5c05245 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: .version_select at 0x7f1448838ca0>, body: {"keypair": {"name": "tempest-keypair-996795641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Lc3Yd2woTMRO4OEaYijHrxGzfPPPYg0+WBVDJe6lkusSp4HBCz2CYJ97PgBclOldSL27F9GBbICDQbXwXzdaZ1cQzsWIHX65t7iAQBpW9QPaa4EsnnKnD7k+MRxSSRQ=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:36.047935 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-2375250d-6920-4b43-8037-01efd5c05245 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for project d9f6ff4cee09476c925730a31d32e56f. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:36.051792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-2375250d-6920-4b43-8037-01efd5c05245 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for user 213a7f6737504f9eb89a2e51ddd639ff and project d9f6ff4cee09476c925730a31d32e56f. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:36.075702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2375250d-6920-4b43-8037-01efd5c05245 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045766 Jun 07 16:02:36.076297 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 274/522] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Jun 7 16:02:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 16:02:36.655133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:36.655732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:36.662326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:36.662783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:36.663549 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:36.664064 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:36.888895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:36.896563 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-eeba9dfd-ba0f-41e8-b8ac-d6b641dfc9e4 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.245311 Jun 07 16:02:36.906336 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 249/523] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:36 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:37.056206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-181fc152-d7fb-4a1f-bb13-729f67dc8113 req-d2cb35d8-b98e-4a0f-94f1-3673f52d2c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68445d53-da9e-442d-93b8-0e70c601457f", "name": "network-vif-plugged", "status": "completed", "tag": "9e4269dc-abca-4501-a92b-01c74411106c"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:37.065255 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-181fc152-d7fb-4a1f-bb13-729f67dc8113 req-d2cb35d8-b98e-4a0f-94f1-3673f52d2c0e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:37.066333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-181fc152-d7fb-4a1f-bb13-729f67dc8113 req-d2cb35d8-b98e-4a0f-94f1-3673f52d2c0e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:37.079750 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-181fc152-d7fb-4a1f-bb13-729f67dc8113 req-d2cb35d8-b98e-4a0f-94f1-3673f52d2c0e service nova] Creating event network-vif-plugged:9e4269dc-abca-4501-a92b-01c74411106c for instance 68445d53-da9e-442d-93b8-0e70c601457f on hv-cinder-84487 Jun 07 16:02:37.084723 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-181fc152-d7fb-4a1f-bb13-729f67dc8113 req-d2cb35d8-b98e-4a0f-94f1-3673f52d2c0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Jun 07 16:02:37.087002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 275/524] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:37.539155 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1493224096", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bca6588e-929f-4019-b79c-d0c7387dc8b6"}], "security_groups": [{"name": "tempest-securitygroup--374821458"}], "key_name": "tempest-keypair-996795641", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:37.545755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:37.546435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=10 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:37.645917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] validate_networks() for [('bca6588e-929f-4019-b79c-d0c7387dc8b6', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:02:37.913846 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:37.914473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:37.921315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:37.921772 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:37.922540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:37.922976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:38.154199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:38.163339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-34dc2e10-6a3e-4765-b627-479d632691a0 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1366 microversion: 2.1 time: 0.253617 Jun 07 16:02:38.164392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 276/525] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:37 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:02:38.164764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:02:38.165539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:02:38.165749 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:02:38.166165 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:02:38.166573 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:02:38.175776 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:38.176222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:38.177047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:38.177485 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:38.196381 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for project d9f6ff4cee09476c925730a31d32e56f. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:02:38.198665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:38.201251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Getting quotas for user 213a7f6737504f9eb89a2e51ddd639ff and project d9f6ff4cee09476c925730a31d32e56f. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:02:38.214898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:02:38.217453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:02:38.274746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1723015d-6812-46be-bc48-5b4f9c158c7f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.740393 Jun 07 16:02:38.276744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 250/526] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Jun 7 16:02:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 16:02:38.287274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:38.287872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:38.346675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:38.355704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:38.357237 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:38.358341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-370ea335-9624-44ee-a169-aaf2b4526503 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1281 microversion: 2.20 time: 0.075314 Jun 07 16:02:38.358893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 277/527] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:38 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:02:39.181851 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:39.182400 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:39.189106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.189713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.190516 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.190951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.322910 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:39.330413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3d1b4ebb-d14d-49be-9525-8e6987dbffc6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1554 microversion: 2.1 time: 0.153515 Jun 07 16:02:39.330976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 251/528] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:02:39 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:02:39.347324 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:39.347950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:39.355676 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.356164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.356952 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.357391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.377390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:39.378006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:39.385259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.385716 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.386526 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:39.386966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:39.455136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:39.463622 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:39.464109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8f8e700c-73e1-4f69-8b26-2fb8f3531c9e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120665 Jun 07 16:02:39.464763 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 278/529] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:02:39 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:39.467996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:39.469168 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dace216c-e761-414e-981f-ab6cebd4179d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1333 microversion: 2.20 time: 0.096006 Jun 07 16:02:39.469721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 252/530] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:39 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:02:40.488147 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:40.488722 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:40.495671 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:40.496130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:40.496937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:40.497382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:40.655528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:40.665297 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:40.666805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:40.667903 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7c1e816e-433c-468f-8f0e-0e339ada31b9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1339 microversion: 2.20 time: 0.184377 Jun 07 16:02:40.668483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 279/531] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:40 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:41.050522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-2333f35d-1775-4391-a5b8-beab560355b7 req-b990d36f-fab2-48f6-82aa-e23f24a097ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68445d53-da9e-442d-93b8-0e70c601457f", "tag": "9e4269dc-abca-4501-a92b-01c74411106c"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:41.059839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2333f35d-1775-4391-a5b8-beab560355b7 req-b990d36f-fab2-48f6-82aa-e23f24a097ee service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:41.060322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2333f35d-1775-4391-a5b8-beab560355b7 req-b990d36f-fab2-48f6-82aa-e23f24a097ee service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:41.072618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-2333f35d-1775-4391-a5b8-beab560355b7 req-b990d36f-fab2-48f6-82aa-e23f24a097ee service nova] Creating event network-changed:9e4269dc-abca-4501-a92b-01c74411106c for instance 68445d53-da9e-442d-93b8-0e70c601457f on hv-cinder-84487 Jun 07 16:02:41.077566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-2333f35d-1775-4391-a5b8-beab560355b7 req-b990d36f-fab2-48f6-82aa-e23f24a097ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030698 Jun 07 16:02:41.078201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 253/532] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:41.686405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:41.687620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:41.700343 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:41.700828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:41.701603 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:41.702041 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:41.968653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:41.977850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:41.979378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:41.980860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-29455b0f-2b9e-415e-bfbf-bc58ec4e77cb tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.298187 Jun 07 16:02:41.981395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 280/533] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:41 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:42.999914 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:43.000633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:43.007010 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:43.007508 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:43.008212 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:43.008685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:43.101389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-07d72e08-4f78-41aa-91e4-8592cc9bb2d8 req-40104992-90fd-4fc2-900c-371ec0b9c044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:43.110660 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-07d72e08-4f78-41aa-91e4-8592cc9bb2d8 req-40104992-90fd-4fc2-900c-371ec0b9c044 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:43.111186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-07d72e08-4f78-41aa-91e4-8592cc9bb2d8 req-40104992-90fd-4fc2-900c-371ec0b9c044 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:43.123250 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-07d72e08-4f78-41aa-91e4-8592cc9bb2d8 req-40104992-90fd-4fc2-900c-371ec0b9c044 service nova] Creating event network-changed:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:02:43.128211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-07d72e08-4f78-41aa-91e4-8592cc9bb2d8 req-40104992-90fd-4fc2-900c-371ec0b9c044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Jun 07 16:02:43.129782 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 281/534] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:02:43.155303 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:43.164170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:43.166019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:43.167135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ec35c99e-7e4d-463d-acf4-28f9f4d57070 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.172064 Jun 07 16:02:43.168069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 254/535] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:42 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:44.185827 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:44.186449 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:44.192724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:44.193181 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:44.193946 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:44.195169 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:44.394078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:44.407305 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:44.409277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:44.410391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-92425e4e-0ec6-4ca2-9724-8c07b087bf93 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.229581 Jun 07 16:02:44.410961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 282/536] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:44 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:45.430346 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:45.430956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:45.437364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:45.437810 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:45.438554 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:45.438982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:45.567030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:45.575418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:45.577024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:45.578132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-204642bb-8b96-4751-ab29-73a8853987c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.152838 Jun 07 16:02:45.578757 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 255/537] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:45 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:46.596764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:46.597277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:46.604341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:46.604825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:46.605866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:46.606307 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:46.736858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:46.745407 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:46.746900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:46.747981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8a9101f2-cc05-481e-8e98-2cb6d4f92e06 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.155284 Jun 07 16:02:46.748564 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 283/538] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:46 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:47.765746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:47.766350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:47.773248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:47.773699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:47.774452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:47.774884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:47.899991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:47.902305 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:47.909744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:47.911254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:47.912349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3b4c9fb0-2eab-4553-b071-3e831a49b898 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.150501 Jun 07 16:02:47.912964 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 256/539] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:47 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:48.930438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:48.931045 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:48.933612 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=8 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:48.939120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:48.939572 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:48.940405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:48.940878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:49.081750 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:49.090387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:49.091888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:49.093035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9859d904-5cd6-4589-8054-674a794e67c1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.166820 Jun 07 16:02:49.093605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 284/540] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:48 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:49.108925 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-d30097b9-7ce7-48c2-9859-c3933057c67c req-4bfea854-d36a-4f97-9ac5-21c87cd0bb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "name": "network-vif-plugged", "status": "completed", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:49.115590 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:49.116226 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:49.120387 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d30097b9-7ce7-48c2-9859-c3933057c67c req-4bfea854-d36a-4f97-9ac5-21c87cd0bb8e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:49.120859 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d30097b9-7ce7-48c2-9859-c3933057c67c req-4bfea854-d36a-4f97-9ac5-21c87cd0bb8e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:49.136769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d30097b9-7ce7-48c2-9859-c3933057c67c req-4bfea854-d36a-4f97-9ac5-21c87cd0bb8e service nova] Creating event network-vif-plugged:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:02:49.141693 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-d30097b9-7ce7-48c2-9859-c3933057c67c req-4bfea854-d36a-4f97-9ac5-21c87cd0bb8e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Jun 07 16:02:49.142296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 257/541] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:02:50.110632 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:50.111251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:50.113674 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:02:50.119331 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:50.119784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:50.120585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:50.121026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:50.255532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:50.263687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:50.265244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:50.266345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e267f28b-fd7f-440e-a950-28e3e1da6585 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1406 microversion: 2.20 time: 0.159630 Jun 07 16:02:50.266897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 285/542] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:50 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:51.285639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:51.286336 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:51.293095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:51.293583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:51.294323 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:51.294738 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:51.426787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:51.435369 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:51.436897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:02:51.438068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8f81ce5c-46b6-4588-bdbe-13c91be83b7a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1598 microversion: 2.20 time: 0.157161 Jun 07 16:02:51.438609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 258/543] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:02:51 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:02:51.455525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:02:51.456089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:02:51.463242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:51.463699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:51.464503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:51.464942 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:51.542752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6df8032e-b7e2-45ec-8c72-8f59011fbe33 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091048 Jun 07 16:02:51.543351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 286/544] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Jun 7 16:02:51 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 16:02:52.686574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-60ca409c-2239-4d68-841e-a2ec49ddceb6 req-c1b03cbc-a679-4314-a161-a5feb36c25de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:02:52.695492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-60ca409c-2239-4d68-841e-a2ec49ddceb6 req-c1b03cbc-a679-4314-a161-a5feb36c25de service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:02:52.695926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-60ca409c-2239-4d68-841e-a2ec49ddceb6 req-c1b03cbc-a679-4314-a161-a5feb36c25de service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:02:52.706537 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-60ca409c-2239-4d68-841e-a2ec49ddceb6 req-c1b03cbc-a679-4314-a161-a5feb36c25de service nova] Creating event network-changed:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:02:52.712543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-60ca409c-2239-4d68-841e-a2ec49ddceb6 req-c1b03cbc-a679-4314-a161-a5feb36c25de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029510 Jun 07 16:02:52.713581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 259/545] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:02.610142 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:02.611060 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=62 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:02.614902 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:02.616593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:02.623437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.623882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.624657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.625084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.654532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9435234c-0a9d-462d-9e79-75f6287bc54a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045676 Jun 07 16:03:02.655104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 287/546] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:03:02 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:03:02.714523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:02.715105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:02.717733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:02.718388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=11 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:02.724263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.724736 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.726370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.726811 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.752701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:03:02.825001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-38be9794-3591-49d0-8228-abe31f55443b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 204 len: 0 microversion: 2.1 time: 0.114348 Jun 07 16:03:02.825475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 260/547] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:03:02 2022] DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:03:02.833432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:02.834035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:02.840954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.841420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.842218 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:02.842675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:02.973261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:02.981981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3e61ef07-1660-497c-8844-42291e9c0570 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1672 microversion: 2.1 time: 0.152320 Jun 07 16:03:02.982553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 288/548] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:02 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:04.000174 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:04.000828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:04.007273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:04.007712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:04.008495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:04.008929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:04.136432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:04.143930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-839b547c-26e9-4509-a3a3-6aef6c6d28a2 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1672 microversion: 2.1 time: 0.148060 Jun 07 16:03:04.144533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 261/549] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:03 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:05.160763 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:05.161375 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:05.168249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:05.168808 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:05.169598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:05.170037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:05.367720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:05.375374 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e73b8380-73f1-4359-a661-2c5928d43270 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1672 microversion: 2.1 time: 0.218401 Jun 07 16:03:05.375966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 289/550] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:05 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:06.097194 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-04ed0e44-0544-4152-a315-6a78007f05eb req-1a5d7d22-4b3c-4459-9115-2a53ad2dc367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bdb18ec-9446-430f-a00e-92e1c847f165", "name": "network-vif-deleted", "tag": "4ecb2897-4e5c-4117-b213-8efd5b37c89e"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:06.107407 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-04ed0e44-0544-4152-a315-6a78007f05eb req-1a5d7d22-4b3c-4459-9115-2a53ad2dc367 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:06.107854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-04ed0e44-0544-4152-a315-6a78007f05eb req-1a5d7d22-4b3c-4459-9115-2a53ad2dc367 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:06.120935 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-04ed0e44-0544-4152-a315-6a78007f05eb req-1a5d7d22-4b3c-4459-9115-2a53ad2dc367 service nova] Creating event network-vif-deleted:4ecb2897-4e5c-4117-b213-8efd5b37c89e for instance 7bdb18ec-9446-430f-a00e-92e1c847f165 on hv-cinder-84487 Jun 07 16:03:06.126230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-04ed0e44-0544-4152-a315-6a78007f05eb req-1a5d7d22-4b3c-4459-9115-2a53ad2dc367 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Jun 07 16:03:06.127106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 262/551] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:06.392294 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:06.393353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:06.399430 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:06.399879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:06.400669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:06.401108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:06.433849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:06.434222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:06.434668 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lazy-loading 'fault' on Instance uuid 7bdb18ec-9446-430f-a00e-92e1c847f165 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:06.478747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:06.486448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e9234525-94be-4825-a050-0ad6c528ae59 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 200 len: 1326 microversion: 2.1 time: 0.098037 Jun 07 16:03:06.487020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 290/552] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:06 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:07.504037 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:07.504757 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:07.511852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:07.512310 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:07.513068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:07.513498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:07.526802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 HTTP/1.1 Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:03:07.528403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:03:07.529941 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '7bdb18ec-9446-430f-a00e-92e1c847f165'} Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:03:07.530771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:03:07.531953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:07.533061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:03:07.533061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f6573e34-931e-43f3-aa34-25e665250f87 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 404 len: 111 microversion: 2.1 time: 0.030469 Jun 07 16:03:07.533061 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 263/553] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:07 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:03:07.538876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0d5012d7-30a6-47e7-8131-37c275ee6350 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '.version_select at 0x7f14483bbca0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:07.557751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0d5012d7-30a6-47e7-8131-37c275ee6350 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749618303" status: 202 len: 0 microversion: 2.1 time: 0.022704 Jun 07 16:03:07.558347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 291/554] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 7 16:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749618303 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:03:08.176201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-dfa42bcc-bc9d-4de7-aac7-624ecbeb1680 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: .version_select at 0x7f14484fbee0>, body: {"keypair": {"name": "tempest-keypair-27947122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhXXGhXJ6c0H7WVVi8mb5I3Tsdkmh2fAHb4vwWzFxjoozR+ZOvylRxMA/9R/68v1Tt+l7OrikqjBJmYTE2LshBD5WZvhWsp1dxXC0Oz4lEmeFwRyrA4trapxQKFw8oqNw=="}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:08.189981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-dfa42bcc-bc9d-4de7-aac7-624ecbeb1680 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:03:08.193878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-dfa42bcc-bc9d-4de7-aac7-624ecbeb1680 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for user 8348af929ea740f3981631020a219f80 and project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'key_pairs'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:03:08.215791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-dfa42bcc-bc9d-4de7-aac7-624ecbeb1680 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.043453 Jun 07 16:03:08.216398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 264/555] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:03:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:08.817601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89307049-a746-4952-9297-0cf79ca71cc9"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:08.819309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:08.825898 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:08.826353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:08.827120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:08.827647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:09.076810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0e2d67c2-db8c-4a24-9e48-af3ed32364e8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263443 Jun 07 16:03:09.077692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 292/556] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:03:08 2022] POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:09.519463 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-411946193", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaeb9c5f-0bb1-4407-ad5c-9ab482299357"}], "security_groups": [{"name": "tempest-securitygroup--1696707197"}], "key_name": "tempest-keypair-27947122", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:09.620660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] validate_networks() for [('aaeb9c5f-0bb1-4407-ad5c-9ab482299357', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:03:09.971326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:03:09.971748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:03:09.972220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:03:09.972677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:03:09.973089 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:03:09.982135 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:09.982580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:09.983368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:09.983804 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:09.999912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:03:10.003874 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Getting quotas for user 8348af929ea740f3981631020a219f80 and project 9d0733c937754d1182c68bd4ea7f283c. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:03:10.015210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:03:10.017467 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:03:10.066114 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ac2a7af1-f060-4aa5-b74b-4e01fa1d0f36 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.551488 Jun 07 16:03:10.066748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 265/557] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:03:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:03:10.077668 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ced5be29-0153-4e81-92d1-6a6b659d3689 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:10.078465 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ced5be29-0153-4e81-92d1-6a6b659d3689 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:10.134321 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ced5be29-0153-4e81-92d1-6a6b659d3689 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:10.141430 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ced5be29-0153-4e81-92d1-6a6b659d3689 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1235 microversion: 2.1 time: 0.068389 Jun 07 16:03:10.142007 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 293/558] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:10 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:11.159661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:11.160272 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:11.168610 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:11.169065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:11.169834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:11.170278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:11.250881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:11.260483 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c06b811c-d98a-49f7-b103-fe964cfbe3db tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1305 microversion: 2.1 time: 0.105171 Jun 07 16:03:11.261415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 266/559] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:11 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:12.278559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:12.279180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:12.286724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:12.287192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:12.287949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:12.288418 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:12.501861 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:12.510482 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ff312699-48a6-4ada-b050-ac4e56d534b0 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.236381 Jun 07 16:03:12.511060 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 294/560] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:12 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:12.638997 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-d3298759-8536-4b46-a75e-c5fa2cc20889 req-421209a0-c680-4817-b4c2-6b94f6d79e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3bd5575-db33-4a06-9d45-7a83ed77e7ad", "tag": "0f8222bc-a5ba-4988-8987-c489cf085cff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:12.652993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d3298759-8536-4b46-a75e-c5fa2cc20889 req-421209a0-c680-4817-b4c2-6b94f6d79e29 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:12.653702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d3298759-8536-4b46-a75e-c5fa2cc20889 req-421209a0-c680-4817-b4c2-6b94f6d79e29 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:12.665668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d3298759-8536-4b46-a75e-c5fa2cc20889 req-421209a0-c680-4817-b4c2-6b94f6d79e29 service nova] Creating event network-changed:0f8222bc-a5ba-4988-8987-c489cf085cff for instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad on hv-cinder-84487 Jun 07 16:03:12.670625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-d3298759-8536-4b46-a75e-c5fa2cc20889 req-421209a0-c680-4817-b4c2-6b94f6d79e29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Jun 07 16:03:12.671247 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 267/561] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:13.528992 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:13.529705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:13.536469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.536924 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.537740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.538178 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.781734 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:13.782315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:13.789898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.790351 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.791128 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.791567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.818042 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:03:13.895063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-aa7eb360-aeea-48fd-a859-f4d8cc733582 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 204 len: 0 microversion: 2.1 time: 0.117198 Jun 07 16:03:13.895787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 268/562] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:03:13 2022] DELETE /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 16:03:13.904273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:13.905001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:13.906416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:13.911151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.911608 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.913059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:13.913496 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:13.914859 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dda3237b-f9d8-446c-9dff-a23162755931 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.391240 Jun 07 16:03:13.915427 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 295/563] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:13 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:14.042131 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:14.049628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5f5e6863-b9f5-438e-a73a-5a497bfabf56 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1578 microversion: 2.1 time: 0.149643 Jun 07 16:03:14.050200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 269/564] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:13 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:14.931959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:14.932596 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:14.939071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:14.939517 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:14.940266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:14.940722 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:15.066389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:15.067403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:15.068025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:15.074426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-946058f3-d897-4c37-9b4c-cbd99c1e7819 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.146577 Jun 07 16:03:15.074838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:15.075797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 296/565] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:14 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:15.075967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:15.076069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:15.077143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:15.208548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:15.217527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f4d9aba9-e5ec-416f-9fd7-6185630c7a6b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1578 microversion: 2.1 time: 0.154031 Jun 07 16:03:15.218098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 270/566] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:15 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:16.092880 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:16.093436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:16.101301 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:16.101745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:16.102510 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:16.102940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:16.235705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:16.236315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:16.243015 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:16.243457 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:16.244270 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:16.244738 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:16.263771 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:16.271243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7a3f0f62-c99a-4900-a4ee-2bb03aaec87f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.182992 Jun 07 16:03:16.272419 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 297/567] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:16 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:16.377682 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:16.385798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b0e1afc7-e6dd-44a8-8ca6-cef5dc867002 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1578 microversion: 2.1 time: 0.154716 Jun 07 16:03:16.386364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 271/568] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:16 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:17.288411 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:17.289012 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:17.295916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.296542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.297550 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.298042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.403086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:17.403700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:17.409816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.410257 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.411025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.411455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.525273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:17.532989 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-307698e8-2dd0-483e-9932-6765a4d4d150 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1511 microversion: 2.1 time: 0.133562 Jun 07 16:03:17.533546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 272/569] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:17 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1511 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:17.589255 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:17.597422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-84696838-64e7-49fb-9058-d4af5c757989 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.313022 Jun 07 16:03:17.597972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 298/570] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:17 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:17.667508 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:17.668696 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:17.674794 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.675357 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.676408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.676923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.701754 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'flavor' on Instance uuid 4af0f273-7800-41ad-ab0d-95adceaea6a9 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:17.785372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-1bf7840f-d06b-47c7-8a3f-573eb285c83d req-a703b682-bc6c-45c7-be16-be52e9b06a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e23c26-7004-42f2-a16b-0bc65e4db372", "name": "network-vif-deleted", "tag": "b8d3bc5a-d843-4085-b5eb-1e5ac125f708"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:17.796897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-1bf7840f-d06b-47c7-8a3f-573eb285c83d req-a703b682-bc6c-45c7-be16-be52e9b06a8f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.797776 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-1bf7840f-d06b-47c7-8a3f-573eb285c83d req-a703b682-bc6c-45c7-be16-be52e9b06a8f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.811266 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-1bf7840f-d06b-47c7-8a3f-573eb285c83d req-a703b682-bc6c-45c7-be16-be52e9b06a8f service nova] Creating event network-vif-deleted:b8d3bc5a-d843-4085-b5eb-1e5ac125f708 for instance 37e23c26-7004-42f2-a16b-0bc65e4db372 on hv-cinder-84487 Jun 07 16:03:17.817206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-1bf7840f-d06b-47c7-8a3f-573eb285c83d req-a703b682-bc6c-45c7-be16-be52e9b06a8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Jun 07 16:03:17.821644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 299/571] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:17.912773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-22bb48ef-0353-47d7-a3fd-0e13dc61deff tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/action" status: 200 len: 32 microversion: 2.1 time: 0.248506 Jun 07 16:03:17.913399 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 273/572] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:03:17 2022] POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:03:17.924122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:17.925117 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:17.932457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.933004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:17.933801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:17.934520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.204755 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:18.213505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d56b8699-ab90-452c-94a9-11ddd013196a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.294566 Jun 07 16:03:18.214280 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 300/573] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:17 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:18.550981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:18.551880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:18.561570 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:18.562293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.563298 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:18.563949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.606307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:18.606863 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.607406 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lazy-loading 'fault' on Instance uuid 37e23c26-7004-42f2-a16b-0bc65e4db372 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:18.617988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:18.618611 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:18.628222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:18.632118 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:18.633826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.637318 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:18.637770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:18.696055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:18.703532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a821f950-6f83-4e29-83b7-533fab6ee3e5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 200 len: 1185 microversion: 2.1 time: 0.156693 Jun 07 16:03:18.708499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 274/574] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:18 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 1185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:18.878136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:18.886106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-36d2f4b1-8e4b-47ba-bd63-f02fc586ae03 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.274412 Jun 07 16:03:18.886686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 301/575] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:18 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:19.232130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:19.232763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:19.238706 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.239154 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.239902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.240334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.329337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-b09988d3-1aaa-43ca-ac4e-082b9e79103e req-4a214e91-16d7-4a43-bdbd-5006c740e479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3bd5575-db33-4a06-9d45-7a83ed77e7ad", "name": "network-vif-plugged", "status": "completed", "tag": "0f8222bc-a5ba-4988-8987-c489cf085cff"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:19.339567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-b09988d3-1aaa-43ca-ac4e-082b9e79103e req-4a214e91-16d7-4a43-bdbd-5006c740e479 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.340210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-b09988d3-1aaa-43ca-ac4e-082b9e79103e req-4a214e91-16d7-4a43-bdbd-5006c740e479 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.356617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-b09988d3-1aaa-43ca-ac4e-082b9e79103e req-4a214e91-16d7-4a43-bdbd-5006c740e479 service nova] Creating event network-vif-plugged:0f8222bc-a5ba-4988-8987-c489cf085cff for instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad on hv-cinder-84487 Jun 07 16:03:19.366098 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-b09988d3-1aaa-43ca-ac4e-082b9e79103e req-4a214e91-16d7-4a43-bdbd-5006c740e479 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040245 Jun 07 16:03:19.366701 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 302/576] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:19.383030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:19.391569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ed8e237a-0740-4d26-8437-3787c62aa81e tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.163565 Jun 07 16:03:19.392395 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 275/577] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:19 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:19.723409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:19.724027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:19.731237 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.731686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.732467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.732907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.746565 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] HTTP exception thrown: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Request method failure captured: Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 HTTP/1.1 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3X65oQzWBMq0IUmRH2B_w38zFJJobzA4cOf7bSuOw3QkfBMkdBvSO4kxElOqtVLVMqGJidMiLSfFjjjn0YnbaBhdzKOUbAoS2jduXmThMJdaj3hxguC78ogdJxf3Eh1qCl8SACN_FN3y3RQLNrDrAXFgbz8sYFmDeTOCSJaJLp3PU8 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:03:19.748188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44a1ab295b3a423aa2b3183a3e25ec0b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestVolumeBootPattern-646513065 Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: c26cd29ec472479a9a36ac9bb1f05580 Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:03:19.749704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '37e23c26-7004-42f2-a16b-0bc65e4db372'} Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:03:19.750553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:03:19.751930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:19.753183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Returning 404 to user: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:03:19.753183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5b4837a5-acf0-4d10-85be-3bdd376b7f06 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 404 len: 111 microversion: 2.1 time: 0.030939 Jun 07 16:03:19.753183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 303/578] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:19 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:03:19.848928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-559402377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1550618767", "security_groups": [{"name": "tempest-secgroup-smoke-741234381"}], "block_device_mapping_v2": [{"uuid": "a326c066-9930-449f-92b3-0460a3e7a463", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5da0562-0cd6-4376-86ed-2ba23dbfe827"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:19.902833 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:19.903484 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:19.910267 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.910993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.911794 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:19.912244 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:19.973022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] validate_networks() for [('a5da0562-0cd6-4376-86ed-2ba23dbfe827', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:03:19.991509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:20.010503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=10 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:20.139421 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:20.155084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:20.162533 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e8a28912-4478-4a0d-b63d-d34158e9341c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.263517 Jun 07 16:03:20.163768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 304/579] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:19 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:20.402958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:03:20.404839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:03:20.404839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:03:20.404839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:03:20.405138 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:03:20.410162 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:20.410751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:20.414885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:20.416433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:20.417434 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:20.417886 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:20.418644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:20.418753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:20.419080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:20.420419 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:20.437504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:03:20.441496 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for user c26cd29ec472479a9a36ac9bb1f05580 and project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:03:20.502784 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:03:20.504944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a326c066-9930-449f-92b3-0460a3e7a463',volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:03:20.553013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:20.556871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:20.562350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4889a399-2486-4b4a-9f9e-29b093eaa8cd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.156171 Jun 07 16:03:20.562859 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 305/580] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:20 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:20.633998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-db809a4a-ffa0-44d4-8042-b67659e61915 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788817 Jun 07 16:03:20.640095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 276/581] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:03:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:03:20.645039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0c23ad06-1ca0-4fc0-bfee-52a954f40c31 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:20.645732 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0c23ad06-1ca0-4fc0-bfee-52a954f40c31 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:20.705393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0c23ad06-1ca0-4fc0-bfee-52a954f40c31 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:20.712949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0c23ad06-1ca0-4fc0-bfee-52a954f40c31 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1094 microversion: 2.1 time: 0.071760 Jun 07 16:03:20.713529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 306/582] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:20 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:21.179803 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:21.180441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:21.187646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.188097 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.188876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.189312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.324595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:21.332212 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-98489272-6ac4-49e2-bee0-8bd94f925bb9 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1361 microversion: 2.1 time: 0.157026 Jun 07 16:03:21.332936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 277/583] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:21 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:21.579906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:21.580584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:21.587611 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.588055 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.588836 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.589268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.718274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:21.727020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cbf93417-e850-4414-aa75-924cb410c869 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.151029 Jun 07 16:03:21.727614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 307/584] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:21 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:21.731146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:21.731759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:21.738001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.738460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.739199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:21.739665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:21.803017 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:21.811443 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-108346b8-3a31-4cf8-be20-4f42352b93ed tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1192 microversion: 2.1 time: 0.084404 Jun 07 16:03:21.812023 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 278/585] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:21 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:22.349874 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:22.350724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:22.357378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.357827 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.358606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.359042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.746760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:22.747434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:22.754741 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.755293 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.756186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.756710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.786448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:22.795158 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1e1b5f22-b598-486d-8a72-3f637e98da79 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1547 microversion: 2.1 time: 0.449485 Jun 07 16:03:22.795879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 308/586] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:22 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1547 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:22.814183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:22.814659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:22.821320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.821773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.822526 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:22.823955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:22.979679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-377b969b-b553-4bab-8e0b-333c29d9a8ca tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169256 Jun 07 16:03:22.986507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 309/587] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:03:22 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:22.999207 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:22.999752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:23.016648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:23.019585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:23.020047 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:23.021050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:23.021491 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:23.032295 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f55221e3-7601-4335-8905-b611ee61816a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.289454 Jun 07 16:03:23.033776 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 279/588] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:22 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:23.239739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:23.251798 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e61f9d0c-4000-4e90-9b30-04c1c785fcd8 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.265992 Jun 07 16:03:23.252675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 310/589] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:22 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:23.827443 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-cbf740a3-1a9c-4c7e-be0a-e4584a8468eb req-77aafaeb-1394-49a3-918b-564d2c46d3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300403ca-f879-42eb-942e-b71ccfd7d4f9", "tag": "e8077d1d-3d8c-4470-a85e-ad23d31f79df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:23.870667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-cbf740a3-1a9c-4c7e-be0a-e4584a8468eb req-77aafaeb-1394-49a3-918b-564d2c46d3ce service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:23.871370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-cbf740a3-1a9c-4c7e-be0a-e4584a8468eb req-77aafaeb-1394-49a3-918b-564d2c46d3ce service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:23.884974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-cbf740a3-1a9c-4c7e-be0a-e4584a8468eb req-77aafaeb-1394-49a3-918b-564d2c46d3ce service nova] Creating event network-changed:e8077d1d-3d8c-4470-a85e-ad23d31f79df for instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 on hv-cinder-84487 Jun 07 16:03:23.891215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-cbf740a3-1a9c-4c7e-be0a-e4584a8468eb req-77aafaeb-1394-49a3-918b-564d2c46d3ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070357 Jun 07 16:03:23.892682 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 280/590] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:24.050556 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:24.051323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:24.058476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:24.058946 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:24.059779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:24.060229 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:24.191551 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-60fffd26-b2df-4b6c-a321-469e5ac51929 req-303c5bb5-662d-46cf-a465-f6a9097e60f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3bd5575-db33-4a06-9d45-7a83ed77e7ad", "tag": "0f8222bc-a5ba-4988-8987-c489cf085cff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:24.199339 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:24.201556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-60fffd26-b2df-4b6c-a321-469e5ac51929 req-303c5bb5-662d-46cf-a465-f6a9097e60f1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:24.202312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-60fffd26-b2df-4b6c-a321-469e5ac51929 req-303c5bb5-662d-46cf-a465-f6a9097e60f1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:24.215472 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-60fffd26-b2df-4b6c-a321-469e5ac51929 req-303c5bb5-662d-46cf-a465-f6a9097e60f1 service nova] Creating event network-changed:0f8222bc-a5ba-4988-8987-c489cf085cff for instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad on hv-cinder-84487 Jun 07 16:03:24.220944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-60fffd26-b2df-4b6c-a321-469e5ac51929 req-303c5bb5-662d-46cf-a465-f6a9097e60f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032892 Jun 07 16:03:24.223451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 281/591] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:24.273462 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:24.274359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:24.281896 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:24.282614 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:24.283613 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:24.284263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:24.335243 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:24.345015 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-be1bf102-f923-4d2d-92d1-ae24545e842f tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.298567 Jun 07 16:03:24.345601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 311/592] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:24 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:24.567442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:24.575813 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2e07f241-491f-4a3e-a0a3-d7f2d9cbf8ce tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.308831 Jun 07 16:03:24.586544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 282/593] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:24 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:25.363919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:25.364583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:25.371586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.372037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.372822 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.373257 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.483277 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:25.483861 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:25.490418 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.491358 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.492499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.492934 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.516558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1ee7d7eb-6bf4-4a26-a8ed-78853dd9c10b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/ips" status: 200 len: 148 microversion: 2.1 time: 0.037391 Jun 07 16:03:25.517138 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 283/594] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:03:25 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:25.585400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:25.592807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:25.593629 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:25.594632 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5f3e2a90-78ad-4577-ae68-301ae0527cef tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.235512 Jun 07 16:03:25.595225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 312/595] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:25 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:25.602048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.602702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.603460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:25.604044 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:25.745559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:25.753350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-838c2279-ab2e-4bd5-9df9-49c84b3fd20a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.164263 Jun 07 16:03:25.753913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 284/596] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:25 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:26.612258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:26.612821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:26.619431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.619878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.620652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.621083 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.750840 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:26.759432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bd508bb6-427e-45dd-9705-5f396e26b777 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.151150 Jun 07 16:03:26.759999 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 313/597] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:26 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:26.769995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:26.770608 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:26.777398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.777848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.778610 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.779047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.841281 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7155e809-c6d6-492e-9131-6661c5f6b083"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:26.842395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:26.848512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.848965 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.849711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:26.850239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:26.913207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:26.921019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-02da7e83-8e78-406c-9709-099b6cb9f16d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.154861 Jun 07 16:03:26.921681 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 285/598] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:26 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:27.085136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c9ce7c8d-2eab-4057-bffc-15ae21267ffc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247078 Jun 07 16:03:27.085801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 314/599] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:03:26 2022] POST /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:27.776817 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:27.777393 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:27.783839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:27.784289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:27.785076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:27.785507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:27.911072 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:27.919963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-86ffb0c8-f73f-4ce5-8c5d-eb0d75865036 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.147102 Jun 07 16:03:27.920633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 286/600] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:27 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:27.938414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:27.939123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:27.946022 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:27.946558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:27.947469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:27.947918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:28.077026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:28.084541 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5a1de7c0-c8fc-41a9-a9ee-38ad68352d18 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.150708 Jun 07 16:03:28.085265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 315/601] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:27 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:28.937760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:28.938296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:28.945207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:28.945649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:28.946427 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:28.946902 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.077397 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:29.085733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-73d6b613-8233-473a-a7ef-ccda2981cf41 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.151900 Jun 07 16:03:29.086316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 287/602] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:28 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:29.101853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:29.102493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:29.109261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.109717 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.110480 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.110923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.243240 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:29.252177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8774c778-cc93-49a9-8a45-f453e677689c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.154700 Jun 07 16:03:29.259098 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 316/603] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:29 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:29.624804 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:29.625252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:29.631803 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.632249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.633048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.633510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.656217 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lazy-loading 'flavor' on Instance uuid 02aea574-14a9-41bc-8699-a5d3525a3390 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:29.727547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f2df8994-69fe-4d94-97d4-9ee1ce58f41b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "POST /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390/action" status: 202 len: 0 microversion: 2.1 time: 0.106594 Jun 07 16:03:29.728208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 288/604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:03:29 2022] POST /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:03:29.737365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:29.738013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:29.745954 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.746457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.748023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:29.748496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:29.885985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:29.893710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0595b5cc-82b8-44e9-b138-4993a9537db6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.160339 Jun 07 16:03:29.894289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 317/605] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:29 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:30.104469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:30.105170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:30.111587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.112036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:30.112831 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.113266 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:30.245908 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:30.254082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2c2c3dd9-c614-4af9-bc5a-96fc46fd0db3 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.154954 Jun 07 16:03:30.254655 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 289/606] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:30 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:30.268810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:30.269437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:30.275989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.276475 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:30.277271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.277698 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:30.404076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:30.411475 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3b0a5cf5-d254-4200-9f20-74a81c3d31f4 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.146436 Jun 07 16:03:30.412050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 318/607] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:30 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:30.911060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:30.911713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:30.913702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:30.914348 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:30.920161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.920637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:30.921401 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:30.921837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:31.053880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:31.061505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-fc936016-e6cc-4e2d-a5c2-b01cd8a700e6 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.154295 Jun 07 16:03:31.062099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 290/608] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:30 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:31.271028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:31.271563 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:31.274104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:31.279784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:31.280232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:31.281024 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:31.281466 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:31.409483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:31.417656 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dfed920f-b763-495b-a2fc-606b73c3112b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.150564 Jun 07 16:03:31.418222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 319/609] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:31 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:31.429069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:31.429705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:31.435999 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:31.436488 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:31.437252 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:31.437691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:31.456019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:31.571852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:31.579371 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-48dcb530-d1a6-4dbf-9af2-c46ff44a8a99 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.154995 Jun 07 16:03:31.579935 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 291/610] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:31 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:32.079202 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:32.079841 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:32.086326 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.086772 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.087528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.087962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.218032 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:32.226411 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e8f5a1c3-4622-4193-848f-673ddd86d98e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.151050 Jun 07 16:03:32.226976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 320/611] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:32 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:32.434619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:32.435220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:32.441663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.442108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.442853 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.443285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.579453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:32.588106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2985f963-0ac1-4991-9125-cccf075aeffb tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.157302 Jun 07 16:03:32.588724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 292/612] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:32 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:32.595876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:32.596553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:32.603127 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.603578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.604335 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:32.604803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:32.732088 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:32.739447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a7dfb337-5938-46cd-9df6-217cec9d02e6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.147349 Jun 07 16:03:32.740008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 321/613] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:32 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:33.243673 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:33.244441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:33.250430 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.250890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.251646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.252081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.383954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:33.391446 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c8a62209-0b1b-4746-b5ba-10d8424f56be tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.152351 Jun 07 16:03:33.392024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 293/614] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:33 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:33.606275 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:33.606981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:33.609598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:33.614925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.615505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.616818 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.617321 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.636476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:33.753157 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:33.757148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:33.757995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:33.761677 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e37e042d-d67a-4cdf-ae78-19cb9403a647 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.159594 Jun 07 16:03:33.762333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 322/615] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:33 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:33.764905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.765362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.766132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:33.766743 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:33.909210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:33.916966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e9bfd441-a83f-494c-a34a-afb5a326455e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.163759 Jun 07 16:03:33.917544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 294/616] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:33 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:34.408791 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:34.409327 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.416115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.416605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.417367 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.417800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.553943 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:34.561587 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3da79ee0-e1cf-4836-b7de-c28d9d3460c9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.156798 Jun 07 16:03:34.562337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 323/617] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:34 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:34.596494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7155e809-c6d6-492e-9131-6661c5f6b083"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:34.597626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.603693 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.604137 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.604917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.605351 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.682365 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: POST /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments HTTP/1.1 Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 74 Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:03:34.684080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {"volumeAttachment": {"volumeId": "7155e809-c6d6-492e-9131-6661c5f6b083"}} Jun 07 16:03:34.685642 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'server_id': '68445d53-da9e-442d-93b8-0e70c601457f', 'body': {'volumeAttachment': {'volumeId': '7155e809-c6d6-492e-9131-6661c5f6b083'}}} Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:34.686580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:34.688022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 400 to user: Invalid volume: volume 7155e809-c6d6-492e-9131-6661c5f6b083 is already attached to instances: 68445d53-da9e-442d-93b8-0e70c601457f {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a80af9e2-0982-470f-b234-8609208d3b8f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093184 Jun 07 16:03:34.689558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 295/618] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:03:34 2022] POST /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 16:03:34.745682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:34.746190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.752568 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.753019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.753775 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.754211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.778928 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:34.779531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.785993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.786440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.787191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.787828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.836141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'services' on Instance uuid 68445d53-da9e-442d-93b8-0e70c601457f {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:34.912983 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-957f2fbb-2fb1-452b-8771-d5d79e4b9d39 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments/7155e809-c6d6-492e-9131-6661c5f6b083" status: 202 len: 0 microversion: 2.1 time: 0.170926 Jun 07 16:03:34.913828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 324/619] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:03:34 2022] DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments/7155e809-c6d6-492e-9131-6661c5f6b083 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:03:34.923945 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:34.925145 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.931905 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.932382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.933167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.933605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.934162 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:34.944967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-97715a8c-19a3-40a3-9cf6-30f82923e3d9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.169662 Jun 07 16:03:34.955337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 296/620] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:34 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:34.961580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:34.962189 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:34.965596 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d7212df1-e633-495f-bad3-354f2be27f4b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047433 Jun 07 16:03:34.966180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 325/621] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:03:34 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:34.971484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.971933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:34.972722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:34.973177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.102389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:35.110095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cf4bbfbc-7f63-4f1e-b8e0-9ca099a2faab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.153332 Jun 07 16:03:35.110657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 297/622] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:34 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:35.392168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-97d81115-11b1-4ee1-9ba2-4083bd1e344b req-fd8d2403-77bf-4773-a844-87f6d5c4c8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300403ca-f879-42eb-942e-b71ccfd7d4f9", "name": "network-vif-plugged", "status": "completed", "tag": "e8077d1d-3d8c-4470-a85e-ad23d31f79df"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:35.402846 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-97d81115-11b1-4ee1-9ba2-4083bd1e344b req-fd8d2403-77bf-4773-a844-87f6d5c4c8e5 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.403300 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-97d81115-11b1-4ee1-9ba2-4083bd1e344b req-fd8d2403-77bf-4773-a844-87f6d5c4c8e5 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.427251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-97d81115-11b1-4ee1-9ba2-4083bd1e344b req-fd8d2403-77bf-4773-a844-87f6d5c4c8e5 service nova] Creating event network-vif-plugged:e8077d1d-3d8c-4470-a85e-ad23d31f79df for instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 on hv-cinder-84487 Jun 07 16:03:35.433976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-97d81115-11b1-4ee1-9ba2-4083bd1e344b req-fd8d2403-77bf-4773-a844-87f6d5c4c8e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045804 Jun 07 16:03:35.434579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 326/623] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:35.579072 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:35.579690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:35.586480 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.586957 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.587709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.588172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.728575 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:35.736888 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8e9e008e-eb1c-43d4-b598-a5932c0ef872 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.161596 Jun 07 16:03:35.737473 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 298/624] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:35 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:35.962899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:35.963587 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:35.970304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.970755 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.971500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.971938 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.977292 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:35.978285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:35.985132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.985589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:35.986352 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:35.986788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.017891 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-421657e4-40d3-4913-a522-40f5d1897a09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044476 Jun 07 16:03:36.018384 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 299/625] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:03:35 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:03:36.080781 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:36.081471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:36.087518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.087972 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.088766 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.089205 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.106638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:36.114503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:03:36.114703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-edf6d340-87aa-44ea-891e-a8121fa11508 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.156010 Jun 07 16:03:36.115343 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 327/626] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:35 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:36.129358 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:36.129964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:36.136577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.137104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.137987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.138485 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.195055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-042dff66-5fa7-4d26-ba00-2b580f41242e tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 204 len: 0 microversion: 2.1 time: 0.117767 Jun 07 16:03:36.196087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 300/627] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:03:36 2022] DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 16:03:36.201390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:36.201961 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:36.207912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.208369 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.209233 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.209859 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.233556 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f15fae93-cff7-43eb-bd8a-31ecc2a3b2fd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/ips" status: 200 len: 152 microversion: 2.20 time: 0.036091 Jun 07 16:03:36.234132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 301/628] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Jun 7 16:03:36 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 16:03:36.238369 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:36.239167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:36.245877 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.246432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.247070 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.247500 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.287235 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:36.296496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b0bc008f-3ccb-40bb-ad74-6a1586925287 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.170754 Jun 07 16:03:36.297477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 328/629] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:36 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:36.389162 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:36.397388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ceca8619-790f-4157-8eaf-b534226eb799 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1679 microversion: 2.1 time: 0.162280 Jun 07 16:03:36.397966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 302/630] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:36 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:36.754636 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:36.755245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:36.762000 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.762447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.763197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:36.763631 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:36.890500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:36.898355 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-71ee5f7e-67dd-422b-844a-d237277302a3 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.147539 Jun 07 16:03:36.898925 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 329/631] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:36 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:37.133256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:37.133783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:37.140069 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.140561 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.141313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.141745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.270149 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:37.278659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-97b2cc72-8526-40a9-82c9-5fc90b6ec9e4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.149348 Jun 07 16:03:37.279230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 303/632] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:37 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:37.314566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:37.315184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:37.321875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.322328 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.323088 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.323531 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.415004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:37.415622 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:37.422079 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.422562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.423332 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.423768 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.456384 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:37.466116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c1c3a50b-4349-4a8a-ab47-3663ee38bd97 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.155355 Jun 07 16:03:37.466708 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 330/633] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:37 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:37.556868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:37.565086 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ec424964-cfcf-40ec-b959-56c4fd3a0d5a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1679 microversion: 2.1 time: 0.154133 Jun 07 16:03:37.566686 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 304/634] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:37 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:37.915182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:37.915799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:37.921895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.922351 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:37.923108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:37.923542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.055144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:38.062633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e1cc4924-3eae-4e08-9a1b-4d91d8902a83 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.151355 Jun 07 16:03:38.063201 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 331/635] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:37 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:38.296558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:38.297097 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:38.303640 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.304081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.304867 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.305300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.330643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:38.331250 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:38.338203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.338656 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.339428 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.339867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.367050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lazy-loading 'flavor' on Instance uuid f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:03:38.449269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:38.458090 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-25d1b34d-649f-47c0-8268-d478d488dc19 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.165550 Jun 07 16:03:38.458789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 305/636] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:38 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:38.486481 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:38.487453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:38.495383 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.495914 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.496800 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.497326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.680893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e672b4c2-8e85-4979-a52c-858860e83479 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/action" status: 202 len: 0 microversion: 2.20 time: 0.354018 Jun 07 16:03:38.681709 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 332/637] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 7 16:03:38 2022] POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 16:03:38.687797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:38.688527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:38.696299 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.696797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:38.697793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:38.698225 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.088056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.093001 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:39.101215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b84a1ec1-de8d-4749-aa27-a63fbfae07cb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1265 microversion: 2.1 time: 0.620319 Jun 07 16:03:39.111779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 306/638] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:38 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1265 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:39.117510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:39.118891 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:39.120808 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.128188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.128933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.129860 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.130444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.132900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f6d461c1-ba2d-4157-995c-7d161a5e4bd9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1679 microversion: 2.1 time: 0.450046 Jun 07 16:03:39.136759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 333/639] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:38 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1679 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:39.143645 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:39.144233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:39.156332 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.156821 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.157758 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.158210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.437795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.446215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.447735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.448996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5843d2c3-8703-434d-8260-37c0009c7808 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.336010 Jun 07 16:03:39.449559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 307/640] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:39 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:39.454956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.463657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ddcc2db2-b8b6-4074-b6c1-b918ae6b0e53 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.325814 Jun 07 16:03:39.464241 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 334/641] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:39 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:39.477816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:39.478421 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:39.484995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.485447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.486227 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:39.486671 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:39.709929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:39.717969 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8e68fb35-b1ba-49fb-83fa-9b3d6398b4ba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.244225 Jun 07 16:03:39.718551 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 308/642] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:39 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:40.124108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-123a8444-f7f3-4c78-8ad1-0103af086982 req-c94c3af9-b655-4030-a796-1e2236328a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68445d53-da9e-442d-93b8-0e70c601457f", "name": "network-vif-deleted", "tag": "9e4269dc-abca-4501-a92b-01c74411106c"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:40.129285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.129980 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.137531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-123a8444-f7f3-4c78-8ad1-0103af086982 req-c94c3af9-b655-4030-a796-1e2236328a1b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.141026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.141545 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.142037 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-123a8444-f7f3-4c78-8ad1-0103af086982 req-c94c3af9-b655-4030-a796-1e2236328a1b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.145206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.145646 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.161669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-123a8444-f7f3-4c78-8ad1-0103af086982 req-c94c3af9-b655-4030-a796-1e2236328a1b service nova] Creating event network-vif-deleted:9e4269dc-abca-4501-a92b-01c74411106c for instance 68445d53-da9e-442d-93b8-0e70c601457f on hv-cinder-84487 Jun 07 16:03:40.167577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-123a8444-f7f3-4c78-8ad1-0103af086982 req-c94c3af9-b655-4030-a796-1e2236328a1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046851 Jun 07 16:03:40.168514 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 309/643] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:40.174326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.175028 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.182288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.182747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.183513 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.183943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.271137 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.282539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5269172c-15ec-4356-8406-a4fceee3ca3b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 200 len: 1612 microversion: 2.1 time: 0.112516 Jun 07 16:03:40.284057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 310/644] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:40.319086 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.327609 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b7b564c8-8662-4c1c-9873-4069fea7c91f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1452 microversion: 2.1 time: 0.212240 Jun 07 16:03:40.328809 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 335/645] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:40.344931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.345700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.353141 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.353732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.354832 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.355391 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.470104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.471297 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.478738 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.479665 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.480696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.481589 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.510546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.518140 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f4897266-a863-4566-8503-4ba909ca9991 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1452 microversion: 2.1 time: 0.177298 Jun 07 16:03:40.529828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 311/646] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:40.529828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.529828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.543134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.543589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.544397 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.544840 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.788911 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.798729 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.800584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:40.803864 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7680b36e-bda9-4926-b9e6-5705aca55c5e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.338573 Jun 07 16:03:40.804901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 336/647] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:03:40.821578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:40.822573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:40.830146 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.830501 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.831269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:40.831700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:40.836967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:41.020484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:41.029577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f8162232-261b-420a-b5be-79e070cefded tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.509661 Jun 07 16:03:41.030082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 312/648] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:41.106194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:41.115027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-27f7ad2a-df46-49df-aa12-262a125f4c89 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.299434 Jun 07 16:03:41.116749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 337/649] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:40 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:41.303559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:41.304491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:41.310748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:41.311444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:41.312411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:41.312954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:41.329391 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f HTTP/1.1 Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:03:41.331108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:03:41.332582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '68445d53-da9e-442d-93b8-0e70c601457f'} Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:03:41.333432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:03:41.334930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:03:41.336239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:03:41.336239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1914a6de-a845-49ec-9e1a-0ecbd5331350 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 404 len: 111 microversion: 2.1 time: 0.034896 Jun 07 16:03:41.340456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 313/650] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:41 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:03:41.345447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b882c5b4-a2c5-43e0-9fed-f54b2087ac09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '.version_select at 0x7f1448411040>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:41.366658 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b882c5b4-a2c5-43e0-9fed-f54b2087ac09 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021422276" status: 202 len: 0 microversion: 2.1 time: 0.025071 Jun 07 16:03:41.368471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 338/651] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 7 16:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021422276 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 16:03:41.823038 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:41.823656 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:41.830163 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:41.830611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:41.831377 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:41.831809 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:42.000605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84da5ec9-89e8-45fc-91cb-f43bea17cb30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: .version_select at 0x7f14483d7160>, body: {"keypair": {"name": "tempest-keypair-369268972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2WAERVHMVjP142uciwZNsuJgJ4tqYjM4h1DYoHna9wK3Dt5DJtgvRqZC2YJzOTeDxMprSpU1htidbMcVcmIi9m4PsVWoYETtY4sF7vNhHh4gHVSLwtegDseOJrQ+ghKQ=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:42.017166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-84da5ec9-89e8-45fc-91cb-f43bea17cb30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:03:42.023077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-84da5ec9-89e8-45fc-91cb-f43bea17cb30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:03:42.048284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-84da5ec9-89e8-45fc-91cb-f43bea17cb30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051600 Jun 07 16:03:42.054887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 339/652] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:03:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:42.054887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:42.054887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:42.063397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:42.063926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:42.064899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:42.065416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:42.327923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:42.339991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:42.341690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:42.342998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4e4c4e58-a25d-4d55-8373-94d7c49ca44c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.523982 Jun 07 16:03:42.343884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 314/653] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:41 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:42.354636 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:42.355537 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:42.362991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:42.363720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:42.364610 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:42.367020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:42.581151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:42.591285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fa0be610-3805-4cf8-a884-c3809ca50062 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.541173 Jun 07 16:03:42.601269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 340/654] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:42 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:42.640254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:42.649773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cb6d2221-980a-479a-8d64-27a74cb78513 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1735 microversion: 2.1 time: 0.305208 Jun 07 16:03:42.650674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 315/655] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:42 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:43.362721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:43.364171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:43.379713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.380481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.381466 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-bd14d2e6-0ead-4a8a-b496-7c423978172c req-3ef0a77b-caca-411a-bf7f-5a50419b83e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300403ca-f879-42eb-942e-b71ccfd7d4f9", "tag": "e8077d1d-3d8c-4470-a85e-ad23d31f79df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:43.383630 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.384814 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.417140 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-bd14d2e6-0ead-4a8a-b496-7c423978172c req-3ef0a77b-caca-411a-bf7f-5a50419b83e7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.420687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-bd14d2e6-0ead-4a8a-b496-7c423978172c req-3ef0a77b-caca-411a-bf7f-5a50419b83e7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.443706 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-bd14d2e6-0ead-4a8a-b496-7c423978172c req-3ef0a77b-caca-411a-bf7f-5a50419b83e7 service nova] Creating event network-changed:e8077d1d-3d8c-4470-a85e-ad23d31f79df for instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 on hv-cinder-84487 Jun 07 16:03:43.452587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-bd14d2e6-0ead-4a8a-b496-7c423978172c req-3ef0a77b-caca-411a-bf7f-5a50419b83e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076350 Jun 07 16:03:43.453782 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 316/656] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:43.461243 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1033317239", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c78cec0-a2d6-49be-a908-94b7edf4c82d"}], "security_groups": [{"name": "tempest-securitygroup--444511828"}], "key_name": "tempest-keypair-369268972", "user_data": "}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:43.620852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:43.623596 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] validate_networks() for [('5c78cec0-a2d6-49be-a908-94b7edf4c82d', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:03:43.628847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:43.630625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:43.632070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-122a0307-9533-4b7b-8a90-c2df812c3b03 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.273714 Jun 07 16:03:43.632667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 341/657] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:43 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:43.637234 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:43.638032 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:43.646948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.650721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.651567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.652011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.846702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:43.854807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8d39f960-1f1d-4546-85c3-78e583cd4106 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.220969 Jun 07 16:03:43.864251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 342/658] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:43 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:43.864251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:43.864251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:43.868235 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.868804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:43.869792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:43.870348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.112909 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:44.121265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6f127c00-2e69-45c7-8917-ef02d6ef2adc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1715 microversion: 2.1 time: 0.264221 Jun 07 16:03:44.122108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 343/659] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:43 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1715 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:44.164862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:03:44.165367 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:03:44.165944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:03:44.166417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:03:44.166895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:03:44.176767 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.177332 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.179223 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.179779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:44.179903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.180376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.190980 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.191525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.192424 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.192939 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.203228 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:03:44.207273 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Getting quotas for user f47acc995d80476cbd4153e9121e97eb and project e601e41f827a4c6f8c743a174ac463fa. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:03:44.220275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:03:44.222998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:03:44.283316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4097a6ad-fac2-40eb-a805-d078f0998d35 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.828073 Jun 07 16:03:44.283569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] HTTP exception thrown: Cannot 'detach_volume' instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 while it is in vm_state rescued Jun 07 16:03:44.284683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 317/660] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:03:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Request method failure captured: Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments/89307049-a746-4952-9297-0cf79ca71cc9 HTTP/1.1 Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3YB9jh1gsMMPbVQTbCCB5Izz7_yiT_tPNoot629O01IoH3v8Bh8YJxGDBUJ28g2gsesMcPhYLvwc9Vwm6pT1Uo2z4VMc8ymnTlTRGlK5bgpU3gPqqpaLeWHrwoRwZp-GvLvxnWlL22lcoR5e5K3BzRJS1tZk9YgfFkbNs1XtX1ps_A Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:03:44.289696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_960d9a6b1f514344aa82bbada2b878ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: e9ca987fc23d4ff1a88dd4ed7b38980c Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:03:44.291236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Cannot 'detach_volume' instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 while it is in vm_state rescued Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'server_id': '4af0f273-7800-41ad-ab0d-95adceaea6a9', 'id': '89307049-a746-4952-9297-0cf79ca71cc9'} Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:03:44.292040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 while it is in vm_state rescued Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 while it is in vm_state rescued Jun 07 16:03:44.293567 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:03:44.294829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Returning 409 to user: Cannot 'detach_volume' instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 while it is in vm_state rescued {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:03:44.295807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-84d3d1c9-60a5-461a-aa11-3350342a5eba tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments/89307049-a746-4952-9297-0cf79ca71cc9" status: 409 len: 152 microversion: 2.1 time: 0.120122 Jun 07 16:03:44.296784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 344/661] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:03:44 2022] DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments/89307049-a746-4952-9297-0cf79ca71cc9 => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 07 16:03:44.304285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2f7ca02a-b0a5-4c9e-bec4-7046dd8f4561 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:44.305085 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2f7ca02a-b0a5-4c9e-bec4-7046dd8f4561 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.314947 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:44.315500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.322403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.322845 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.324058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.324669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.410741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2dac9d93-b970-44e2-b921-9f127f09bc64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/action" status: 202 len: 0 microversion: 2.1 time: 0.109616 Jun 07 16:03:44.411773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 345/662] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:03:44 2022] POST /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:03:44.422675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:44.424026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.433536 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.434117 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.435163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.435677 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.636860 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2f7ca02a-b0a5-4c9e-bec4-7046dd8f4561 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:44.645463 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2f7ca02a-b0a5-4c9e-bec4-7046dd8f4561 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1241 microversion: 2.1 time: 0.349083 Jun 07 16:03:44.646084 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 318/663] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:44 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1241 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:44.655018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:44.655018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.657190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:44.661878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.663769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.664723 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.665335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.729261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:44.741150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9b706ac7-5073-48f2-b04b-a9dcf47af4e0 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1723 microversion: 2.1 time: 0.323761 Jun 07 16:03:44.741732 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 346/664] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:44 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:44.871269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:44.871996 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:44.884025 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.884853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:44.885701 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:44.886360 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:45.043937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:45.053674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:45.056139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:45.058774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-feb91aba-8388-45b2-842d-bc285bf127fc tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.410033 Jun 07 16:03:45.059954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 319/665] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:44 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:45.138928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:45.146366 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-bfeb8afc-f153-4ee4-a2d9-035934b3473b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.278880 Jun 07 16:03:45.147588 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 347/666] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:44 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:45.663344 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:45.663956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:45.671249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:45.671698 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:45.672490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:45.672930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:45.762968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:45.763620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:45.770430 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:45.770881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:45.772269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:45.772614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:45.990424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:45.998441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cc4f7af7-e7c9-4957-9c71-6387fb9e7609 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1299 microversion: 2.1 time: 0.339753 Jun 07 16:03:45.999103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 320/667] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:45 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1299 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:46.079208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:46.079817 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:46.086539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.086990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:46.087751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.088186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:46.389740 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:46.398186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-936d39aa-6959-418e-8f6c-c373b194cdb8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1723 microversion: 2.1 time: 0.639130 Jun 07 16:03:46.398768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 348/668] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:45 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:46.403546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:46.404158 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:46.410731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.411187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:46.411990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.412491 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:46.456318 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:46.466492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:46.468000 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:46.469322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5b1b4bd8-6773-4442-9ed5-7f40c918556f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.394091 Jun 07 16:03:46.470058 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 321/669] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:46 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:03:46.819308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:46.827017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-876fa3f5-0166-400b-8af8-78640855607e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1510 microversion: 2.1 time: 0.427045 Jun 07 16:03:46.827593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 349/670] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:46 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:46.845291 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:46.846486 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:46.853923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.855476 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:46.856550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:46.857139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.012842 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ea668ff4-f3f7-4d4e-93ad-bf4c37cfeda0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "POST /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390/action" status: 202 len: 0 microversion: 2.1 time: 0.172478 Jun 07 16:03:47.017915 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 322/671] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:03:46 2022] POST /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:03:47.020532 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:47.021249 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:47.025003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:47.025837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:47.033086 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.033691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.033960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.034285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.035827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.036161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.036657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.037390 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.154749 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.164933 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5f911345-ce0e-4fff-8b2d-acfc5a961933 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1299 microversion: 2.1 time: 0.152504 Jun 07 16:03:47.165699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 350/672] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:47 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:47.315933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.326294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a4329cd8-66c5-4105-bd5d-8f50c8096357 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1518 microversion: 2.1 time: 0.306928 Jun 07 16:03:47.328474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 323/673] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:47 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1518 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:47.415973 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:47.416781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:47.423160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.423614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.424417 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.424865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.489998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:47.492036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:47.498477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.498931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.500248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:47.502236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:47.617383 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.625771 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6f8ca45b-9b02-4622-af53-943c2cf57993 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1723 microversion: 2.1 time: 0.214526 Jun 07 16:03:47.626353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 351/674] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:47 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:47.665710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.674742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.676413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:47.677683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1ff761a9-2aa2-461e-8349-5b9a4b58eda4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.192923 Jun 07 16:03:47.679039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 324/675] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:47 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:48.183747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:48.184461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:48.190871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.191325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.192084 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.192559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.324319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:48.331741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e0e89117-2b78-4c94-ae08-0a64da7deaf5 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.151906 Jun 07 16:03:48.332310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 352/676] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:48 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:48.344691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:48.345306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:48.352267 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.352744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.353502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.353937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.484939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:48.495200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cadfe1f1-f412-47d5-bdf2-021e171e48b8 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1518 microversion: 2.1 time: 0.154244 Jun 07 16:03:48.496134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 325/677] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:48 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:48.645317 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:48.646182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:48.654196 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.666912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.667992 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.668467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.697068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:48.697998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:48.705588 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.706492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.708259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:48.709454 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:48.714915 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:49.044782 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.050968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.053795 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cc6becec-e55a-4438-83b8-2d4eefd93029 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1723 microversion: 2.1 time: 0.413586 Jun 07 16:03:49.054579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 353/678] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:48 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:49.063471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.063471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.063850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-24148d65-6e87-40bd-9043-12141cf2a195 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.371239 Jun 07 16:03:49.064609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 326/679] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:48 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:49.351340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:49.352059 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:49.363062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.363557 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.366713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.368408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.444801 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-b40ab1a7-16d3-4ac6-a4bd-2038fd0e5acf req-5a698fd8-15e0-46a8-8fa8-d0722b5f8b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "name": "network-vif-unplugged", "status": "completed", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:49.462404 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-b40ab1a7-16d3-4ac6-a4bd-2038fd0e5acf req-5a698fd8-15e0-46a8-8fa8-d0722b5f8b56 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.463036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-b40ab1a7-16d3-4ac6-a4bd-2038fd0e5acf req-5a698fd8-15e0-46a8-8fa8-d0722b5f8b56 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.477412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.compute.server_external_events [req-b40ab1a7-16d3-4ac6-a4bd-2038fd0e5acf req-5a698fd8-15e0-46a8-8fa8-d0722b5f8b56 service nova] Unable to find a host for instance 02aea574-14a9-41bc-8699-a5d3525a3390. Dropping event network-vif-unplugged {{(pid=117819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 16:03:49.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-b40ab1a7-16d3-4ac6-a4bd-2038fd0e5acf req-5a698fd8-15e0-46a8-8fa8-d0722b5f8b56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039753 Jun 07 16:03:49.480850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 327/680] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 16:03:49.498844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-77fea555-766c-4ff4-bbed-7f9c11f912b2 req-2ad1e9db-9b95-4af3-8d23-0ecd180d05a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3069cab6-3ca9-422f-a5b1-f95e5ee44d9b", "tag": "9949b721-992d-4b54-bd2b-4b397867eeba"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:49.514956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-77fea555-766c-4ff4-bbed-7f9c11f912b2 req-2ad1e9db-9b95-4af3-8d23-0ecd180d05a7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.515666 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-77fea555-766c-4ff4-bbed-7f9c11f912b2 req-2ad1e9db-9b95-4af3-8d23-0ecd180d05a7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.531597 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-77fea555-766c-4ff4-bbed-7f9c11f912b2 req-2ad1e9db-9b95-4af3-8d23-0ecd180d05a7 service nova] Creating event network-changed:9949b721-992d-4b54-bd2b-4b397867eeba for instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b on hv-cinder-84487 Jun 07 16:03:49.543372 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-77fea555-766c-4ff4-bbed-7f9c11f912b2 req-2ad1e9db-9b95-4af3-8d23-0ecd180d05a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044664 Jun 07 16:03:49.545630 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 328/681] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:49.555246 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:49.556676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:49.566990 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.567843 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.569459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:49.570146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:49.791764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.796291 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:49.802197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6cc1cc7c-0924-4938-8e22-b178e7d2063d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.457187 Jun 07 16:03:49.803826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 354/682] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:49 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:49.912525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:49.920525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-44b8ab72-8def-43b9-a7b8-66a97b23051e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1520 microversion: 2.1 time: 0.373373 Jun 07 16:03:49.921433 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 329/683] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:49 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:50.071278 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:50.071802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:50.078900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.079610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.080391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.080830 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.083485 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:50.085139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:50.092164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.092835 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.093897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.094628 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.812678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:50.821674 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e5c60943-4254-4d0b-a51c-4406178f8d5a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1729 microversion: 2.1 time: 0.754545 Jun 07 16:03:50.822261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 355/684] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:50 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1729 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:50.826767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:50.827385 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:50.831913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:50.833356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.834142 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.834635 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.835075 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.843620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:50.845424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:50.846857 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a79f383f-9806-4241-9f8b-e5d976dce7ef tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.767821 Jun 07 16:03:50.847559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 330/685] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:50 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:03:50.852315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:50.852847 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:50.859193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.859639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:50.860442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:50.860880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.017527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-69986665-3cab-49d6-8ca5-37a1010250f8 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168586 Jun 07 16:03:51.018267 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 331/686] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:03:50 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:51.030332 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:51.031235 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:51.039029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:51.039478 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.040454 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:51.040904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.146129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:51.154518 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0cd071e9-961d-49ef-977a-66d9eabd7564 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.331124 Jun 07 16:03:51.154969 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 356/687] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:50 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:51.211858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:51.219562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-99aec92f-de35-4270-955a-f9c03633cccc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.194113 Jun 07 16:03:51.220248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 332/688] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:51 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:51.879201 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:51.879866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:51.887507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:51.887960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.888771 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:51.889175 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.925691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-aadb4eb7-601e-4c15-9e18-acd684a936e7 req-afd0e627-b2ab-40fd-a458-5d6394e156c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:51.935637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-aadb4eb7-601e-4c15-9e18-acd684a936e7 req-afd0e627-b2ab-40fd-a458-5d6394e156c7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:51.936437 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-aadb4eb7-601e-4c15-9e18-acd684a936e7 req-afd0e627-b2ab-40fd-a458-5d6394e156c7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:51.949960 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-aadb4eb7-601e-4c15-9e18-acd684a936e7 req-afd0e627-b2ab-40fd-a458-5d6394e156c7 service nova] Creating event network-changed:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:03:51.955687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-aadb4eb7-601e-4c15-9e18-acd684a936e7 req-afd0e627-b2ab-40fd-a458-5d6394e156c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033589 Jun 07 16:03:51.956408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 333/689] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:52.030388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=4 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:52.172022 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:52.172881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:52.180577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:52.181065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:52.182013 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:52.182648 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:52.364460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:52.373228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:52.374894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:52.376190 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-aa043af2-f8a9-4fe0-8da2-f285bd546649 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.500977 Jun 07 16:03:52.387834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 357/690] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:51 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:52.387834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:52.387834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:52.390141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:52.390691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:52.391559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:52.392220 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:52.674412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:52.682884 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b30e6861-1ed3-4da9-8b03-a4c931e8ab37 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.514972 Jun 07 16:03:52.692572 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 334/691] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:52 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:52.860769 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:52.868585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f24ce10e-e019-44b6-a7c8-0bc299464eb4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.490591 Jun 07 16:03:52.869153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 358/692] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:52 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:53.397800 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:53.398569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:53.405439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.405890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.406669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.407110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.699791 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:53.700441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:53.706979 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.707423 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.708182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.709144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.875238 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:53.884005 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:53.885967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:53.887125 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-28d2e2e9-2bac-4816-91b1-6342f1939837 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.495571 Jun 07 16:03:53.887742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 335/693] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:53 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:53.892269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:53.892904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:53.899286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.899725 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.900498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.900933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.916285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:53.923722 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6f6fbc7a-8760-4521-ba53-8f0f9b56ed57 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.227805 Jun 07 16:03:53.924388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 359/694] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:53 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:53.970313 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-fa9fea20-6222-467d-ae1e-4181e4b0fe8f req-46aece9c-33bd-4c4c-ab1d-2048b61f07d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:53.979649 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa9fea20-6222-467d-ae1e-4181e4b0fe8f req-46aece9c-33bd-4c4c-ab1d-2048b61f07d0 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:53.980308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa9fea20-6222-467d-ae1e-4181e4b0fe8f req-46aece9c-33bd-4c4c-ab1d-2048b61f07d0 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:53.993431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-fa9fea20-6222-467d-ae1e-4181e4b0fe8f req-46aece9c-33bd-4c4c-ab1d-2048b61f07d0 service nova] Creating event network-changed:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:03:53.998629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-fa9fea20-6222-467d-ae1e-4181e4b0fe8f req-46aece9c-33bd-4c4c-ab1d-2048b61f07d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Jun 07 16:03:53.999403 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 360/695] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:03:54.112930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:54.121364 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-da6da73f-4381-4342-812a-c8879f0a52e0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.232702 Jun 07 16:03:54.121943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 336/696] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:53 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:54.907216 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:54.907933 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:54.914915 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:54.915368 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:54.916130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:54.916605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:54.941410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:54.941945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:54.944012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:54.945189 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=8 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:54.952051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:54.952617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:54.953479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:54.953920 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:55.099721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:55.108106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:55.109647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:55.110805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-81ce37dc-1e7a-46d3-a10d-5bb5540bac6f tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1744 microversion: 2.20 time: 0.208475 Jun 07 16:03:55.111366 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 361/697] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:54 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:55.126566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:55.134117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-32fb4163-fb85-43dc-94b3-b25f44f5de32 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.196573 Jun 07 16:03:55.134700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 337/698] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:54 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:55.138519 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:55.139135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:55.145055 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:55.145499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:55.146642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:55.146962 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:55.276682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:55.284175 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f86764ed-99cb-4f73-9af2-027689a05acb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.149738 Jun 07 16:03:55.284777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 362/699] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:55 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:55.526526 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-762ee672-95b1-4333-8dfa-a0d2aa8948f9 req-a32108b1-e640-4695-8c34-0014a88c2aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3069cab6-3ca9-422f-a5b1-f95e5ee44d9b", "name": "network-vif-plugged", "status": "completed", "tag": "9949b721-992d-4b54-bd2b-4b397867eeba"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:55.535730 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-762ee672-95b1-4333-8dfa-a0d2aa8948f9 req-a32108b1-e640-4695-8c34-0014a88c2aba service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:55.536188 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-762ee672-95b1-4333-8dfa-a0d2aa8948f9 req-a32108b1-e640-4695-8c34-0014a88c2aba service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:55.549601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-762ee672-95b1-4333-8dfa-a0d2aa8948f9 req-a32108b1-e640-4695-8c34-0014a88c2aba service nova] Creating event network-vif-plugged:9949b721-992d-4b54-bd2b-4b397867eeba for instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b on hv-cinder-84487 Jun 07 16:03:55.554659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-762ee672-95b1-4333-8dfa-a0d2aa8948f9 req-a32108b1-e640-4695-8c34-0014a88c2aba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Jun 07 16:03:55.555464 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 338/700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:56.130154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:56.130737 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:56.137448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.137900 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.138667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.139109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.152419 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:56.153127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:56.159752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.160206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.160996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.161428 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.337140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:56.340136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:56.345332 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:56.346918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:56.347449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b52dfe64-b9bd-4976-9cd6-958d99c76332 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.200219 Jun 07 16:03:56.348020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 339/701] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:56 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:03:56.348221 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-66f52bfe-7d36-412e-bb15-59b313175ed7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1744 microversion: 2.20 time: 0.222169 Jun 07 16:03:56.348989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 363/702] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:56 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:03:56.354055 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:56.354667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:56.360814 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.361259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.362003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:56.362432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:56.488509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:56.496094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c7b8ed5a-c03e-4eb7-baed-cf84352772a4 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.146502 Jun 07 16:03:56.496698 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 340/703] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:56 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:57.364723 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:57.367063 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:57.367681 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:57.368122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:57.374667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.374844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.375115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.375219 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.375871 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.375974 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.376299 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.376417 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.579066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:57.583012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:57.587659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-52906f23-0c31-4bd7-8f70-0f96f060ee1d tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1366 microversion: 2.1 time: 0.226686 Jun 07 16:03:57.588232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 364/704] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:57 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:57.592043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:57.593617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:57.594772 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1e694261-0446-4dfe-9fa6-5efb8fa3d4b5 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.232167 Jun 07 16:03:57.595325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 341/705] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:57 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:03:57.597456 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:57.598140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:57.604793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.605506 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.606595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:57.607211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:57.745565 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:57.758719 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-990d4a3e-97a5-46de-8ea7-18aec6db8ae9 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.168798 Jun 07 16:03:57.760862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 365/706] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:57 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:58.604475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:58.605766 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:58.614006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:58.615934 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:58.623141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:03:58.627458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.627916 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.628719 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.630598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.631242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.632006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.632468 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.633084 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.870872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:58.874380 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:58.882687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-55f68c43-cabc-4d7e-8b0f-138ca81d608b tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1554 microversion: 2.1 time: 0.282158 Jun 07 16:03:58.883153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:58.893914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:58.893914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-548f5c60-7d7d-4d13-b7cb-2c53c73fd289 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.275837 Jun 07 16:03:58.893914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 366/707] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:58 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:03:58.893914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:58.894430 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:58.897152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 342/708] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:58 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1554 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:58.899835 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.900371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.901159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.901597 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.903416 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:58.904067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:58.910940 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.911602 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:58.913156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:58.914346 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:59.035841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9465c916-9fed-49d1-a46f-493c527fc519 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136777 Jun 07 16:03:59.036951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 343/709] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 7 16:03:58 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:59.166405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:03:59.174542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4fdfaaf4-66f6-405b-9132-e2e551a8d395 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.286579 Jun 07 16:03:59.176425 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 367/710] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:03:58 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:03:59.588309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-bcf0563d-3474-4df1-98c5-c9b34ad80570 req-7af932ca-aae7-4fcb-bf2a-8c310ff7537e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "name": "network-vif-plugged", "status": "completed", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:03:59.601354 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-bcf0563d-3474-4df1-98c5-c9b34ad80570 req-7af932ca-aae7-4fcb-bf2a-8c310ff7537e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:59.602217 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-bcf0563d-3474-4df1-98c5-c9b34ad80570 req-7af932ca-aae7-4fcb-bf2a-8c310ff7537e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:59.629647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-bcf0563d-3474-4df1-98c5-c9b34ad80570 req-7af932ca-aae7-4fcb-bf2a-8c310ff7537e service nova] Creating event network-vif-plugged:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:03:59.636287 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-bcf0563d-3474-4df1-98c5-c9b34ad80570 req-7af932ca-aae7-4fcb-bf2a-8c310ff7537e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051502 Jun 07 16:03:59.637667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 344/711] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:03:59.903304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:03:59.904640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:03:59.914409 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:59.915071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:03:59.916103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:03:59.916673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:00.141662 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:00.164781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:00.166660 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:00.168075 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cc4d119d-2555-48f3-b9a1-dc87ce710150 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.268804 Jun 07 16:04:00.169185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 368/712] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:03:59 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:00.191432 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:00.192119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:00.200046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:00.200046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:00.200717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:00.201147 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:00.271721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-2ec92833-655d-45ef-8bae-b84d86c4c968 req-776b3137-f887-41ec-b9ab-5b283b402218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3069cab6-3ca9-422f-a5b1-f95e5ee44d9b", "tag": "9949b721-992d-4b54-bd2b-4b397867eeba"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:00.289894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-2ec92833-655d-45ef-8bae-b84d86c4c968 req-776b3137-f887-41ec-b9ab-5b283b402218 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:00.290340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-2ec92833-655d-45ef-8bae-b84d86c4c968 req-776b3137-f887-41ec-b9ab-5b283b402218 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:00.311478 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-2ec92833-655d-45ef-8bae-b84d86c4c968 req-776b3137-f887-41ec-b9ab-5b283b402218 service nova] Creating event network-changed:9949b721-992d-4b54-bd2b-4b397867eeba for instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b on hv-cinder-84487 Jun 07 16:04:00.323619 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-2ec92833-655d-45ef-8bae-b84d86c4c968 req-776b3137-f887-41ec-b9ab-5b283b402218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055997 Jun 07 16:04:00.327099 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 369/713] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:04:00.423739 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:00.433103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-67364bda-09bb-4de4-b0fc-10b7682d577d tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.245651 Jun 07 16:04:00.436006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 345/714] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:00 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:01.190728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:01.191673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:01.199680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:01.200265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:01.201388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:01.202033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:01.374261 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:01.388317 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:01.390669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:01.391785 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7fc65b83-8835-44a6-881b-77cd7586bd10 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.208308 Jun 07 16:04:01.392387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 370/715] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:01 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:01.451201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:01.451717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:01.466519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:01.467341 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:01.468470 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:01.469159 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:01.663775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:01.674758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:01.678695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-04a3556e-4861-4f17-aa01-7ac221961260 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.231247 Jun 07 16:04:01.692260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 346/716] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:01 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:02.410687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:02.411284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:02.419019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:02.419688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:02.420676 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:02.421309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:02.697508 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:02.699096 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:02.707240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:02.708142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:02.709745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:02.710174 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:02.878642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:02.887233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:02.888780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:02.890276 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7304f146-6dc0-4a85-94e0-845ea37ab383 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.483417 Jun 07 16:04:02.903625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 371/717] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:02 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:02.910498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:02.919504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b15082d7-d6ee-4645-938e-8d55d27fb44c tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.226816 Jun 07 16:04:02.928495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 347/718] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:02 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:04:03.606919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-0538ad0e-172d-4c4a-a8e1-c650145fd8b0 req-30927ac3-d18e-49b9-8657-d7919488421d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "name": "network-vif-plugged", "status": "completed", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:03.618627 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-0538ad0e-172d-4c4a-a8e1-c650145fd8b0 req-30927ac3-d18e-49b9-8657-d7919488421d service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:03.623141 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-0538ad0e-172d-4c4a-a8e1-c650145fd8b0 req-30927ac3-d18e-49b9-8657-d7919488421d service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:03.639371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-0538ad0e-172d-4c4a-a8e1-c650145fd8b0 req-30927ac3-d18e-49b9-8657-d7919488421d service nova] Creating event network-vif-plugged:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:04:03.644232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-0538ad0e-172d-4c4a-a8e1-c650145fd8b0 req-30927ac3-d18e-49b9-8657-d7919488421d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041182 Jun 07 16:04:03.645180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 372/719] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:03.913366 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:03.914812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:03.922780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:03.923717 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:03.924777 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:03.925461 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:03.954568 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:03.955699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:03.978421 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:03.979265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:03.980453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:03.981381 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:04.003789 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=100 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:04.250833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:04.260478 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:04.260899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:04.263230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:04.264424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-77033686-49ff-4308-9fae-78c246a0fb36 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.357443 Jun 07 16:04:04.266912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 348/720] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:03 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:04.279005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-44c0fdca-1d97-4d1c-8af9-b1ec30e1e3cb tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.341516 Jun 07 16:04:04.280156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 373/721] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:03 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:05.289920 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:05.290669 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:05.313039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:05.313039 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:05.328122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:05.335708 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:05.336625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:05.337081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:05.341009 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:05.341459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:05.342231 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:05.342666 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:05.556579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:05.566360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:05.569164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-35532e5d-97f4-4a37-b7d3-d6225f644561 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1576 microversion: 2.1 time: 0.273830 Jun 07 16:04:05.573476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 374/722] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:05 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:04:05.576388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:05.578098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:05.579440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d2f3d9ba-d17b-4210-a81a-e3744d173e39 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.295427 Jun 07 16:04:05.582911 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 349/723] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:05 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:06.589373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:06.590830 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:06.598106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:06.598643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:06.599842 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:06.600504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:06.601503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:06.602134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:06.606979 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:06.608098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:06.609916 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:06.610849 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:06.829988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:06.834618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:06.841256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:06.842637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-687732ee-911c-4bf5-a273-7091fdb1ce94 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1563 microversion: 2.1 time: 0.258197 Jun 07 16:04:06.842773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:06.856400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 375/724] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:06 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:06.856619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-57c708d3-fc14-4080-a340-fd7cb96295e8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1739 microversion: 2.20 time: 0.249339 Jun 07 16:04:06.856619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 350/725] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:06 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:04:07.874576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:07.875186 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:07.882223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:07.882663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:07.883417 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:07.883849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:08.018874 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:08.019363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:08.025805 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:08.026106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:08.026944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:08.027333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:08.050390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2f391f91-db27-4288-a944-6c52da488102 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/ips" status: 200 len: 145 microversion: 2.1 time: 0.093018 Jun 07 16:04:08.051021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 351/726] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:04:07 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:04:08.099875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:08.108607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:08.110361 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:08.111546 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-342f16d5-3cb1-4c2e-a0df-be95e5006ef8 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1721 microversion: 2.20 time: 0.240955 Jun 07 16:04:08.112100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 376/727] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:07 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:09.182738 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:09.183357 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:09.189321 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:09.189770 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:09.190518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:09.190951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:09.324611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:09.332596 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:09.334883 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:09.336041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-86d9a53b-2568-42e9-9746-aa751d7683e9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1721 microversion: 2.20 time: 0.208951 Jun 07 16:04:09.336844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 352/728] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:09 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:09.369606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3ecf039-6a39-4c04-b5d7-80cc083c4c6b"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:09.370671 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:09.377200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:09.377648 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:09.378410 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:09.378847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.146998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-84c0c075-970a-4bc9-be41-b830d0bef59d tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781167 Jun 07 16:04:10.147943 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 377/729] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:04:09 2022] POST /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:10.354527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:10.355068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:10.362136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.362581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.363334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.363763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.496195 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:10.504064 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:10.505640 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:10.506797 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ed997d3a-461c-4075-afc2-06e93a46c6ca tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1724 microversion: 2.20 time: 0.156196 Jun 07 16:04:10.507338 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 353/730] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:10 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:10.526551 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f36aa2-f147-4ea9-b457-79cb72053fe3"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:10.527748 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:10.533955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.534410 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.535162 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.535591 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.820528 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-da3fc163-bcce-4f07-bbfb-92ffd8f37baf tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299981 Jun 07 16:04:10.821197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 378/731] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Jun 7 16:04:10 2022] POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 16:04:10.935080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:10.935611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:10.941634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.942084 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:10.943122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:10.943659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.169081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-231b9221-4754-425e-8876-2658e61697d0 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments/a0f36aa2-f147-4ea9-b457-79cb72053fe3" status: 202 len: 0 microversion: 2.20 time: 0.237837 Jun 07 16:04:11.169667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 354/732] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Jun 7 16:04:10 2022] DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments/a0f36aa2-f147-4ea9-b457-79cb72053fe3 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:04:11.224893 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:11.225465 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:11.232082 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:11.232578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.233361 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:11.233782 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.308948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5ed5d5f9-0687-4827-9db7-5654b7a4c59c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/action" status: 202 len: 0 microversion: 2.20 time: 0.088454 Jun 07 16:04:11.309543 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 379/733] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 7 16:04:11 2022] POST /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:04:11.318164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:11.319504 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:11.325879 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:11.326326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.327073 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:11.327578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.464182 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:11.472305 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:11.473842 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:11.475043 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bb3315be-a2ec-4885-9fb2-c12a08d69a2c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1672 microversion: 2.20 time: 0.161304 Jun 07 16:04:11.475620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 355/734] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:11 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:04:11.648329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-9669b2cd-66f9-4cca-a636-0738c29cbe79 req-2e13429f-09a8-4a36-9322-6bfaa40387c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "name": "network-vif-unplugged", "status": "completed", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:11.656477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-9669b2cd-66f9-4cca-a636-0738c29cbe79 req-2e13429f-09a8-4a36-9322-6bfaa40387c1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:11.656935 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-9669b2cd-66f9-4cca-a636-0738c29cbe79 req-2e13429f-09a8-4a36-9322-6bfaa40387c1 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:11.668714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.compute.server_external_events [req-9669b2cd-66f9-4cca-a636-0738c29cbe79 req-2e13429f-09a8-4a36-9322-6bfaa40387c1 service nova] Unable to find a host for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc. Dropping event network-vif-unplugged {{(pid=117818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 16:04:11.669592 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-9669b2cd-66f9-4cca-a636-0738c29cbe79 req-2e13429f-09a8-4a36-9322-6bfaa40387c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026063 Jun 07 16:04:11.670176 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 380/735] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 16:04:12.493621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:12.494229 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:12.501106 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:12.501555 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:12.502350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:12.502818 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:12.704803 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:12.713437 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:12.714938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:12.716092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8ed39543-9440-4094-8732-52a7f0b4357a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.226490 Jun 07 16:04:12.716686 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 356/736] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:12 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:13.743743 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:13.744451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:13.750653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:13.751310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:13.752154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:13.752692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:13.899713 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:13.909133 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:13.910641 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:13.912561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0dcced85-b5d0-4674-9a7c-02ac3cdd34d7 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.176715 Jun 07 16:04:13.913168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 381/737] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:13 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:14.931937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:14.932720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:14.935164 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=77 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:14.940833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:14.941289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:14.942062 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:14.942501 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:15.082016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:15.090306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:15.091904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:15.093148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c65cfe19-809b-4824-bfbd-bde8a0168f19 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.166001 Jun 07 16:04:15.093700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 357/738] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:14 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:16.111730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:16.112280 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:16.120033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:16.120505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:16.121259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:16.121689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:16.259340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:16.267875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:16.269407 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:16.270577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0064448a-b69b-489c-89b2-c9d1195558b1 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.162904 Jun 07 16:04:16.271471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 382/739] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:16 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:17.290104 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:17.290769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:17.301351 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:17.301794 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:17.302792 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:17.303405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:17.450523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:17.466395 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:17.468195 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:17.469499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e94b3814-7fb4-422a-9d76-269fbfd7f3cd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.183962 Jun 07 16:04:17.470161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 358/740] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:17 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:18.489644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:18.490262 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:18.497385 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:18.497928 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:18.498693 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:18.499189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:18.652666 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:18.662019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:18.663703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:18.664843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fc87fb6a-d964-4a55-a206-6d2df174a895 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.179143 Jun 07 16:04:18.665598 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 383/741] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:18 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:19.683603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:19.684221 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:19.690845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:19.691294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:19.692065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:19.692531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:19.842018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:19.850659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:19.852162 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:19.853343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-53ee6048-d61a-4d95-82b6-de0f534ef2ba tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.173848 Jun 07 16:04:19.853905 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 359/742] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:19 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:20.871647 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:20.872282 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:20.878849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:20.879304 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:20.880094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:20.880595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:21.025692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:21.034961 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:21.036722 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:21.038692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4bc71c76-498d-4641-81fe-3e1d818987ff tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.170970 Jun 07 16:04:21.039537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 384/743] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:20 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:04:22.057895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:22.058477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:22.065186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:22.065634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:22.066388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:22.066823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:22.196170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:22.204100 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:22.205695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:22.206827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1158bea3-ac64-4065-b83a-be320b324c29 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.153773 Jun 07 16:04:22.207382 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 360/744] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:22 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:23.225534 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:23.226157 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:23.232948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:23.233393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:23.234213 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:23.234700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:23.369543 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:23.373034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:23.378296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:23.379783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:23.380949 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1e38476a-68d4-4442-8134-6bbe72b73c8b tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.159334 Jun 07 16:04:23.381587 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 385/745] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:23 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:24.399691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:24.400300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:24.406753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:24.407224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:24.407981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:24.408441 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:24.424314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:24.544587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:24.552564 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:24.554082 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:24.555296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-02afa8f6-206d-46c5-9ce9-8c61bc4bf113 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.160240 Jun 07 16:04:24.555858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 361/746] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:24 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:25.138196 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:25.139165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:25.146904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.147344 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.148103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.148565 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.177420 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c32f8680-77a8-47b8-9fe8-847b0ecec64c tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Jun 07 16:04:25.177963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 386/747] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:25 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:25.188253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:25.188795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:25.194676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.195118 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.195865 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.196980 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.225546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ac1ec6ef-c69a-4fa7-8f36-13a1992d1fef tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b" status: 200 len: 194 microversion: 2.1 time: 0.041272 Jun 07 16:04:25.226116 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 362/748] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 7 16:04:25 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:25.574630 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:25.575168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:25.581206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.581714 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.582461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:25.582892 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:25.716422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:25.724347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:25.725881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:25.727144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d2cfff6c-1cb4-472e-a7c2-5b5f9876121a tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.157517 Jun 07 16:04:25.728132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 387/749] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:25 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:04:26.537575 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250b9f46-6d4a-48dc-b105-af4bdf413099"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:26.538707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:26.545202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:26.545653 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:26.546413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:26.546851 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:26.746505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:26.747686 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:26.754122 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:26.754566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:26.755319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:26.755748 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:26.798033 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-75b451c3-d50e-4cc1-bf70-9dddd5c56358 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "POST /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264012 Jun 07 16:04:26.798871 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 363/750] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:04:26 2022] POST /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:27.051082 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:27.059913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:27.061444 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:27.062631 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-64869324-c69e-439e-b7f1-c94f5464be3c tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.320693 Jun 07 16:04:27.063184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 388/751] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:26 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:04:27.812315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-0691d6da-3d8b-4716-bf1e-05e1e7773584 req-488b2fca-643c-4e51-a606-eee4fd4ed63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "name": "network-vif-plugged", "status": "completed", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:27.822836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-0691d6da-3d8b-4716-bf1e-05e1e7773584 req-488b2fca-643c-4e51-a606-eee4fd4ed63c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:27.824024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-0691d6da-3d8b-4716-bf1e-05e1e7773584 req-488b2fca-643c-4e51-a606-eee4fd4ed63c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:27.834783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-0691d6da-3d8b-4716-bf1e-05e1e7773584 req-488b2fca-643c-4e51-a606-eee4fd4ed63c service nova] Creating event network-vif-plugged:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:04:27.840553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-0691d6da-3d8b-4716-bf1e-05e1e7773584 req-488b2fca-643c-4e51-a606-eee4fd4ed63c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089277 Jun 07 16:04:27.841151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 364/752] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:28.080435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:28.081008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:28.087372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:28.088537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:28.089727 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:28.090168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:28.217054 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:28.225077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:28.226628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:28.227773 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1645fc4c-bd3e-4ad1-96a7-5aeca3e56263 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.151317 Jun 07 16:04:28.228327 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 389/753] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:28 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:29.247657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:29.248294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:29.254943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:29.255410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:29.256165 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:29.256643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:29.387223 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:29.395620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:29.397151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:29.398334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7116b3ec-7fda-4599-89ce-b448204298f4 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1730 microversion: 2.20 time: 0.155259 Jun 07 16:04:29.398886 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 365/754] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:29 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:30.417248 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:30.417810 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:30.420416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=50 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:30.426270 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:30.426779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:30.427615 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:30.428058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:30.553547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:30.561951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:30.563467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:30.564711 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4d86c859-7353-4b73-9293-9d1433594598 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1717 microversion: 2.20 time: 0.151509 Jun 07 16:04:30.565263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 390/755] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:04:30 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:04:32.987212 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:32.987770 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:32.994320 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:32.994825 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:32.996031 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:32.996491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:33.076939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'services' on Instance uuid 4af0f273-7800-41ad-ab0d-95adceaea6a9 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:33.150146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-00f014c3-fb33-46c2-9b86-1bdaed87c511 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments/89307049-a746-4952-9297-0cf79ca71cc9" status: 202 len: 0 microversion: 2.1 time: 0.166782 Jun 07 16:04:33.151609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 366/756] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:04:32 2022] DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments/89307049-a746-4952-9297-0cf79ca71cc9 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:33.159804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:33.160755 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:33.167214 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:33.167823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:33.168666 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:33.169104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:33.198329 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5f199540-63db-4778-9ac7-f00631d02bda tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Jun 07 16:04:33.199124 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 391/757] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:33 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:34.211027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:34.212156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:34.218311 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.218762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.219520 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.219950 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.251880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2e7a4e32-8a25-4db8-b915-16670fd625ae tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Jun 07 16:04:34.252739 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 367/758] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:34 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:34.291182 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:34.292562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:34.299317 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.299774 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.300592 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.301030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.331378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-000bdc04-3ae3-43bd-952f-95f365e69d10 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044091 Jun 07 16:04:34.331933 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 392/759] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:34 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:34.486262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:34.486769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:34.492752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.493200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.493951 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.494430 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.524152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5340dea7-217e-4f21-ace5-04c49ef37896 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b" status: 200 len: 194 microversion: 2.1 time: 0.041771 Jun 07 16:04:34.524754 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 368/760] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 7 16:04:34 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:34.534474 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:34.535213 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:34.541945 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.542397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.543287 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:34.543735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:34.624929 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lazy-loading 'services' on Instance uuid e3bd5575-db33-4a06-9d45-7a83ed77e7ad {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:34.695404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-83e13af7-3c1f-4276-ac17-56747fba9b3b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b" status: 202 len: 0 microversion: 2.1 time: 0.164686 Jun 07 16:04:34.696053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 393/761] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:04:34 2022] DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/d3ecf039-6a39-4c04-b5d7-80cc083c4c6b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:35.265080 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:35.266029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:35.272614 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.273065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.273824 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.274258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.303856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-413dba78-86b8-47ed-bf6c-4a2fd638ab64 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042662 Jun 07 16:04:35.304454 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 369/762] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:35 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:04:35.382718 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:35.383292 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:35.390099 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.390522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.391276 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.391701 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.416987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:04:35.489232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9f4c8cea-02e1-4a6a-b42a-b152256c45a9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 204 len: 0 microversion: 2.1 time: 0.110985 Jun 07 16:04:35.489801 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 394/763] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:35 2022] DELETE /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:04:35.497787 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:35.498377 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:35.504311 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.504791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.505544 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:35.505985 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:35.637406 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:35.644765 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c476a1ce-c580-4cf3-93a9-c6944cde7628 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1689 microversion: 2.1 time: 0.150860 Jun 07 16:04:35.645324 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 370/764] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:35 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:36.662438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:36.663129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:36.670148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:36.670592 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:36.671345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:36.671779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:36.801705 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:36.809547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-24a729f3-93ce-48fc-8bf9-e23c4f0b6702 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1689 microversion: 2.1 time: 0.151318 Jun 07 16:04:36.810115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 395/765] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:36 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:37.826400 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:37.826966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:37.833551 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:37.833991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:37.834742 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:37.835177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:37.969826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:37.977396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e4b08cf9-b656-44ca-a794-a7154e4e6102 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1689 microversion: 2.1 time: 0.154982 Jun 07 16:04:37.977958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 371/766] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:37 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:38.996021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:38.996657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:39.003370 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:39.003819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:39.005312 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:39.005312 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:39.143501 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:39.151461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f0781e7c-b8ef-4881-a67f-fca06be4a4bd tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1689 microversion: 2.1 time: 0.160030 Jun 07 16:04:39.152079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 396/767] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:38 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:40.030438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:40.030965 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:40.037993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.038434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.039193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.039629 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.068105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b65a61b0-d703-4f37-8897-8de54f28adbd tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/250b9f46-6d4a-48dc-b105-af4bdf413099" status: 200 len: 194 microversion: 2.1 time: 0.042864 Jun 07 16:04:40.068731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 372/768] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 7 16:04:40 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/250b9f46-6d4a-48dc-b105-af4bdf413099 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:40.079061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:40.079595 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:40.086062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.086519 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.087306 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.087753 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.169525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:40.170392 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:40.174004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lazy-loading 'services' on Instance uuid e3bd5575-db33-4a06-9d45-7a83ed77e7ad {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:40.176839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.178611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.178611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:40.178611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:40.249870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1212498e-42e4-46f6-9674-024c94bace7a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/250b9f46-6d4a-48dc-b105-af4bdf413099" status: 202 len: 0 microversion: 2.1 time: 0.174571 Jun 07 16:04:40.251943 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 397/769] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:04:40 2022] DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments/250b9f46-6d4a-48dc-b105-af4bdf413099 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:40.416175 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:40.424961 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ee9688ba-b45f-45d1-8ba7-08b9766e01bc tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1689 microversion: 2.1 time: 0.259543 Jun 07 16:04:40.425890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 373/770] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:40 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1689 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:04:41.037438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-40db53d0-1a9c-4a19-be01-942c73c0b8cc req-67dfb643-7240-41e2-af0d-018f88335453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af0f273-7800-41ad-ab0d-95adceaea6a9", "name": "network-vif-deleted", "tag": "5f11220e-58cf-4888-ba67-1f3a06c90ba3"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:41.049793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-40db53d0-1a9c-4a19-be01-942c73c0b8cc req-67dfb643-7240-41e2-af0d-018f88335453 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.050689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-40db53d0-1a9c-4a19-be01-942c73c0b8cc req-67dfb643-7240-41e2-af0d-018f88335453 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.065692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-40db53d0-1a9c-4a19-be01-942c73c0b8cc req-67dfb643-7240-41e2-af0d-018f88335453 service nova] Creating event network-vif-deleted:5f11220e-58cf-4888-ba67-1f3a06c90ba3 for instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 on hv-cinder-84487 Jun 07 16:04:41.072262 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-40db53d0-1a9c-4a19-be01-942c73c0b8cc req-67dfb643-7240-41e2-af0d-018f88335453 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112227 Jun 07 16:04:41.073180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 398/771] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:04:41.428929 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:41.430204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:41.439033 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.439824 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.440907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.441566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.443654 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:41.444386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:41.452786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.453238 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.454028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.454469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.483035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-92e29a0c-ebf5-4d2e-82b1-f558c936bb3a tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058742 Jun 07 16:04:41.484479 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 374/772] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:41 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:04:41.506799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.507348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.507820 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'fault' on Instance uuid 4af0f273-7800-41ad-ab0d-95adceaea6a9 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:41.569451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:41.575395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:41.579745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6a82d8f0-85f9-429f-beba-020261e58d9c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 200 len: 1335 microversion: 2.1 time: 0.140309 Jun 07 16:04:41.580664 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 399/773] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:41 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 1335 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:04:41.619645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:41.621340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:41.629224 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.630176 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.630960 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.631586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.662825 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-755bf6f5-17f6-48b0-be44-6a1f96fe476b tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047872 Jun 07 16:04:41.663713 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 375/774] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:41 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:04:41.720941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:41.721448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:41.728935 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.729391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.730166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.730614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.758074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:04:41.845119 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c92ec00a-14f8-4c2c-84ea-e2690545e0e5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 204 len: 0 microversion: 2.1 time: 0.128046 Jun 07 16:04:41.845858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 400/775] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:41 2022] DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:04:41.854272 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:41.854921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:41.861650 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.862103 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.862870 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:41.863314 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:41.999129 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:42.001691 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:42.009591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f10debbf-11e2-4406-9f09-279c9110c510 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1671 microversion: 2.1 time: 0.159227 Jun 07 16:04:42.010185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 376/776] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:41 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:42.597232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:42.597870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 4af0f273-7800-41ad-ab0d-95adceaea6a9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:42.604295 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:42.605372 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:42.606133 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:42.606832 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:42.619827 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] HTTP exception thrown: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Request method failure captured: Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 HTTP/1.1 Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3YB9jh1gsMMPbVQTbCCB5Izz7_yiT_tPNoot629O01IoH3v8Bh8YJxGDBUJ28g2gsesMcPhYLvwc9Vwm6pT1Uo2z4VMc8ymnTlTRGlK5bgpU3gPqqpaLeWHrwoRwZp-GvLvxnWlL22lcoR5e5K3BzRJS1tZk9YgfFkbNs1XtX1ps_A Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:04:42.621463 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_960d9a6b1f514344aa82bbada2b878ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: e9ca987fc23d4ff1a88dd4ed7b38980c Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. Jun 07 16:04:42.623033 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '4af0f273-7800-41ad-ab0d-95adceaea6a9'} Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:42.623848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. Jun 07 16:04:42.625112 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:42.626263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Returning 404 to user: Instance 4af0f273-7800-41ad-ab0d-95adceaea6a9 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:42.626263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6a68a4d3-a772-4ab7-aee0-1aa64c0c4346 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9" status: 404 len: 111 microversion: 2.1 time: 0.029954 Jun 07 16:04:42.626263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 401/777] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:42 2022] GET /compute/v2.1/servers/4af0f273-7800-41ad-ab0d-95adceaea6a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:42.632045 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1b87e4b3-0a69-4250-9d0d-2f62e28036cf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '.version_select at 0x7f14483c3f70>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:42.650359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1b87e4b3-0a69-4250-9d0d-2f62e28036cf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077424140" status: 202 len: 0 microversion: 2.1 time: 0.022470 Jun 07 16:04:42.650907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 377/778] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 7 16:04:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077424140 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:43.027445 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:43.028136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:43.034092 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:43.034547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:43.035349 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:43.035789 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:43.172897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:43.180399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c20775af-51a7-41e5-8c53-c325470091c5 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1671 microversion: 2.1 time: 0.157484 Jun 07 16:04:43.180974 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 402/779] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:43 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:44.199309 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:44.199953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:44.206830 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:44.207307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:44.208070 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:44.208534 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:44.701059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8348af929ea740f3981631020a219f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0733c937754d1182c68bd4ea7f283c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:44.708903 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-34208dd8-a6d1-40de-be72-fba5dfc23684 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 200 len: 1671 microversion: 2.1 time: 0.514425 Jun 07 16:04:44.709600 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 378/780] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:44 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:45.135606 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-ec700b3b-fd55-435d-a8cf-83e0c9660695 req-2074ab8a-ebd7-4dbf-99fd-a1031a727271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3bd5575-db33-4a06-9d45-7a83ed77e7ad", "name": "network-vif-deleted", "tag": "0f8222bc-a5ba-4988-8987-c489cf085cff"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:45.145352 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-ec700b3b-fd55-435d-a8cf-83e0c9660695 req-2074ab8a-ebd7-4dbf-99fd-a1031a727271 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.146145 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-ec700b3b-fd55-435d-a8cf-83e0c9660695 req-2074ab8a-ebd7-4dbf-99fd-a1031a727271 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.159193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-ec700b3b-fd55-435d-a8cf-83e0c9660695 req-2074ab8a-ebd7-4dbf-99fd-a1031a727271 service nova] Creating event network-vif-deleted:0f8222bc-a5ba-4988-8987-c489cf085cff for instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad on hv-cinder-84487 Jun 07 16:04:45.164951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-ec700b3b-fd55-435d-a8cf-83e0c9660695 req-2074ab8a-ebd7-4dbf-99fd-a1031a727271 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Jun 07 16:04:45.165559 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 403/781] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:45.679667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:45.680785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:45.683152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:45.688451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.688853 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.689609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.690220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.718334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:04:45.727134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:45.728030 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:45.735090 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.735859 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.736838 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.737378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.752483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad HTTP/1.1 Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:04:45.754371 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:45.755724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'e3bd5575-db33-4a06-9d45-7a83ed77e7ad'} Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:45.760180 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:45.761966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:45.763085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:45.763085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0a4ac826-8664-4ff4-a7fe-7bb5146106a1 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 404 len: 111 microversion: 2.1 time: 0.033148 Jun 07 16:04:45.763085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 404/782] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:45 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:04:45.766537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e2b761ae-213f-49cb-b1da-b5f82e7cefce tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '.version_select at 0x7f14483745e0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:45.789009 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e2b761ae-213f-49cb-b1da-b5f82e7cefce tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27947122" status: 202 len: 0 microversion: 2.1 time: 0.027004 Jun 07 16:04:45.793518 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 405/783] 10.222.0.18 () {58 vars in 1214 bytes} [Tue Jun 7 16:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27947122 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:45.963795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-47bf8ca2-d250-4c55-adfe-f5e96101c424 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 204 len: 0 microversion: 2.1 time: 0.287445 Jun 07 16:04:45.968907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 379/784] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:45 2022] DELETE /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:04:45.977760 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:45.978400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:45.986433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.987085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:45.987852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:45.988483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:46.140894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:46.154890 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a7ce5f35-c868-4121-b8a0-5b555787b96c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1506 microversion: 2.1 time: 0.181386 Jun 07 16:04:46.155547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 406/785] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:45 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:04:47.173426 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:47.174127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:47.180663 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:47.181117 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:47.181874 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:47.182312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:47.313405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:47.320813 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-3c06afd1-afe7-47ea-a010-00294bfe18db tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1506 microversion: 2.1 time: 0.151556 Jun 07 16:04:47.321688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 380/786] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:47 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:47.689472 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:47.690102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:47.696164 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:47.696643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:47.697445 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:47.697875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:47.722163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-420ef35f-9f72-48ae-8cde-3e0d75d61788 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/ips" status: 200 len: 147 microversion: 2.1 time: 0.094661 Jun 07 16:04:47.722702 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 407/787] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:04:47 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/ips => generated 147 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:48.337827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:48.338390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:48.345896 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.346340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.347096 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.347525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.475731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:48.484120 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-69a8c746-ad72-44d6-84f4-b693502d2dbf tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1506 microversion: 2.1 time: 0.150310 Jun 07 16:04:48.484715 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 381/788] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:48 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:48.731128 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:48.731972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:48.738561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.739087 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.739857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.740298 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.754594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad HTTP/1.1 Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:04:48.756426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.757955 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'e3bd5575-db33-4a06-9d45-7a83ed77e7ad'} Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:48.758730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.760094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.761580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:48.761580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f17a5716-b8e0-48ec-870b-a890f792f927 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 404 len: 111 microversion: 2.1 time: 0.030735 Jun 07 16:04:48.761580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 408/789] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:48 2022] DELETE /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:48.767131 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:48.767731 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: e3bd5575-db33-4a06-9d45-7a83ed77e7ad] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:48.773814 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.774259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.775015 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:48.775439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:48.791046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad HTTP/1.1 Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:04:48.792737 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.794108 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'e3bd5575-db33-4a06-9d45-7a83ed77e7ad'} Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:48.794875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. Jun 07 16:04:48.796039 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:48.797094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance e3bd5575-db33-4a06-9d45-7a83ed77e7ad could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:48.797094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1da362a7-ed2c-4a10-95a9-3e0efa8a561f tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad" status: 404 len: 111 microversion: 2.1 time: 0.031550 Jun 07 16:04:48.797094 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 382/790] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:48 2022] GET /compute/v2.1/servers/e3bd5575-db33-4a06-9d45-7a83ed77e7ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:49.066498 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8409b7a6-b15b-42a3-b29a-410812b34da4"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:49.067770 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:49.075022 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.075586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.077721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.078341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.194192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-1479677c-748d-44dc-8b21-585de37b7e78 req-0da82195-4de4-4e59-9eb8-59c28ea9e6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d02281-8404-4d09-82b2-ab23ab0623d1", "name": "network-vif-deleted", "tag": "450a9373-1070-42c3-866b-57c165da319e"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:49.204318 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-1479677c-748d-44dc-8b21-585de37b7e78 req-0da82195-4de4-4e59-9eb8-59c28ea9e6b3 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.204954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-1479677c-748d-44dc-8b21-585de37b7e78 req-0da82195-4de4-4e59-9eb8-59c28ea9e6b3 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.217499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-1479677c-748d-44dc-8b21-585de37b7e78 req-0da82195-4de4-4e59-9eb8-59c28ea9e6b3 service nova] Creating event network-vif-deleted:450a9373-1070-42c3-866b-57c165da319e for instance d9d02281-8404-4d09-82b2-ab23ab0623d1 on hv-cinder-84487 Jun 07 16:04:49.223509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-1479677c-748d-44dc-8b21-585de37b7e78 req-0da82195-4de4-4e59-9eb8-59c28ea9e6b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Jun 07 16:04:49.224202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 383/791] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:04:49.375531 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-75a06aae-3115-4c12-bcde-0101e3833b4f tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "POST /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313179 Jun 07 16:04:49.376132 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 409/792] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:04:49 2022] POST /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:49.501987 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:49.502688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:49.509153 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.509605 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.510373 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.510809 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.544160 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.544699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.545343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'fault' on Instance uuid d9d02281-8404-4d09-82b2-ab23ab0623d1 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:49.588901 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:49.597179 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ec48582f-1a0f-4aaf-a438-ad5f389cc6df tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 200 len: 1310 microversion: 2.1 time: 0.099976 Jun 07 16:04:49.597759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 384/793] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:49 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:49.931239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:49.931828 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:49.939001 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.939453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.940209 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.940678 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.954629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 HTTP/1.1 Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:04:49.956263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.957860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '7bdb18ec-9446-430f-a00e-92e1c847f165'} Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:49.959473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.960849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.962063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:49.962063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fbb5800a-0f09-4941-bc5f-8c6b4583f253 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 404 len: 111 microversion: 2.1 time: 0.031311 Jun 07 16:04:49.962063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 410/794] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:49 2022] DELETE /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:49.967943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:49.968606 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] [instance: 7bdb18ec-9446-430f-a00e-92e1c847f165] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:49.974588 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.975038 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.975790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:49.976225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:49.989799 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] HTTP exception thrown: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Request method failure captured: Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 HTTP/1.1 Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3W8R1Amvx1YcbZIxW06WbqViR31mPXjqvJYz4JtPa1N8JhlJLT8EOZ3DGaSii-8G83rtkIJRVe2XbN2qQQWNEi9BHOp2h5IZcQgWp6tvtQeZTupfiPDthDAQsK--ZtpMENo_AgVV3uH2X6itsfv1AyxFF7HFyF7MeinOVk0cCfoWjk Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:04:49.991422 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d0733c937754d1182c68bd4ea7f283c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d0733c937754d1182c68bd4ea7f283c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 9d0733c937754d1182c68bd4ea7f283c Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507145408 Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 8348af929ea740f3981631020a219f80 Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeTestJSON-1507145408-project Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.992907 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '7bdb18ec-9446-430f-a00e-92e1c847f165'} Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:49.993760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. Jun 07 16:04:49.995170 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:49.996550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] Returning 404 to user: Instance 7bdb18ec-9446-430f-a00e-92e1c847f165 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:49.996550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7c85e947-982d-4206-813a-627957fcf2a4 tempest-AttachVolumeTestJSON-1507145408 tempest-AttachVolumeTestJSON-1507145408-project] 10.222.0.18 "GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165" status: 404 len: 111 microversion: 2.1 time: 0.029136 Jun 07 16:04:49.996550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 385/795] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:49 2022] GET /compute/v2.1/servers/7bdb18ec-9446-430f-a00e-92e1c847f165 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:50.615271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:50.615894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: d9d02281-8404-4d09-82b2-ab23ab0623d1] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:50.624309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.624813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.625642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.626093 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.640040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] HTTP exception thrown: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Request method failure captured: Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 HTTP/1.1 Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3YB9jh1gsMMPbVQTbCCB5Izz7_yiT_tPNoot629O01IoH3v8Bh8YJxGDBUJ28g2gsesMcPhYLvwc9Vwm6pT1Uo2z4VMc8ymnTlTRGlK5bgpU3gPqqpaLeWHrwoRwZp-GvLvxnWlL22lcoR5e5K3BzRJS1tZk9YgfFkbNs1XtX1ps_A Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:04:50.641916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_960d9a6b1f514344aa82bbada2b878ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: e9ca987fc23d4ff1a88dd4ed7b38980c Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. Jun 07 16:04:50.643308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'd9d02281-8404-4d09-82b2-ab23ab0623d1'} Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:50.644067 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. Jun 07 16:04:50.645870 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:04:50.648246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Returning 404 to user: Instance d9d02281-8404-4d09-82b2-ab23ab0623d1 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:50.648246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a6ad2fc3-fa76-4b0a-a253-8ca84027ee2c tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1" status: 404 len: 111 microversion: 2.1 time: 0.032759 Jun 07 16:04:50.648246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 411/796] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:50 2022] GET /compute/v2.1/servers/d9d02281-8404-4d09-82b2-ab23ab0623d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:50.652014 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:50.652553 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:50.664068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.664633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.665484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.666145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.698798 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:04:50.781525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8507b7b0-434c-4e8e-b29e-d43337822d0a tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 204 len: 0 microversion: 2.1 time: 0.133137 Jun 07 16:04:50.782390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 386/797] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:04:50 2022] DELETE /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 16:04:50.790566 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:50.791522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:50.800604 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.802862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.803982 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:50.804468 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:50.972831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:50.980318 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c81dfd79-c6b5-48f0-bf24-698b6b0e223b tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.193663 Jun 07 16:04:50.980984 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 412/798] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:50 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:51.999514 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:52.001331 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:52.007769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:52.008220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:52.009007 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:52.009611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:52.154005 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:52.164708 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cd5cfb02-b27c-4cd5-941d-dd0051eecd06 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.170354 Jun 07 16:04:52.165394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 387/799] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:51 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:53.182537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:53.183151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:53.190508 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:53.190967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:53.191747 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:53.192188 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:53.359560 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:53.370050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-35e797ac-9af3-49d3-9744-582db5ec8818 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.191039 Jun 07 16:04:53.370994 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 413/800] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:53 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:54.390834 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:54.391452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:54.397682 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:54.398133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:54.398897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:54.399334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:54.547380 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f96ef272-7a49-4505-91f6-66f2fa2a2074 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Action: 'create', calling method: .version_select at 0x7f14482e85e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1935083575"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:54.626886 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:54.636492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-39a42f30-3663-4f2f-b260-9571ba6e36c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1522 microversion: 2.1 time: 0.249214 Jun 07 16:04:54.637407 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 388/801] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:54 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:54.859433 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f96ef272-7a49-4505-91f6-66f2fa2a2074 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.430147 Jun 07 16:04:54.860382 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 414/802] 10.222.0.18 () {60 vars in 1154 bytes} [Tue Jun 7 16:04:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 432 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 07 16:04:54.871279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-41c6cae7-0596-4f06-83bf-954524285176 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144843b940>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:54.936388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-41c6cae7-0596-4f06-83bf-954524285176 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 200 len: 345 microversion: 2.1 time: 0.066594 Jun 07 16:04:54.936388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 389/803] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 16:04:54 2022] GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:54.991993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-b119d998-4f2c-4a01-b08e-5053465f8fea req-7b4758b6-837a-41f6-9a0f-46d89818ffad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3def1191-4ee0-45d7-b43f-2e16de89e478", "name": "network-vif-deleted", "tag": "4afe8733-9281-4967-aed2-4a9f8c20246a"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:55.004460 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-b119d998-4f2c-4a01-b08e-5053465f8fea req-7b4758b6-837a-41f6-9a0f-46d89818ffad service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:55.004972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-b119d998-4f2c-4a01-b08e-5053465f8fea req-7b4758b6-837a-41f6-9a0f-46d89818ffad service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:55.017282 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-b119d998-4f2c-4a01-b08e-5053465f8fea req-7b4758b6-837a-41f6-9a0f-46d89818ffad service nova] Creating event network-vif-deleted:4afe8733-9281-4967-aed2-4a9f8c20246a for instance 3def1191-4ee0-45d7-b43f-2e16de89e478 on hv-cinder-84487 Jun 07 16:04:55.022861 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-b119d998-4f2c-4a01-b08e-5053465f8fea req-7b4758b6-837a-41f6-9a0f-46d89818ffad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034769 Jun 07 16:04:55.023454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 415/804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:55.654378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:55.654978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:55.661276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:55.661665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:55.662409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:55.662840 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:55.693458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:55.693900 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:55.694338 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lazy-loading 'fault' on Instance uuid 3def1191-4ee0-45d7-b43f-2e16de89e478 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:55.735326 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ca987fc23d4ff1a88dd4ed7b38980c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960d9a6b1f514344aa82bbada2b878ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:04:55.742685 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-60c9a5ba-5756-4ab9-991d-89986a165aa4 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 200 len: 1312 microversion: 2.1 time: 0.092598 Jun 07 16:04:55.743246 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 390/805] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:55 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:04:55.948650 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-5e16b176-1796-4820-a118-2fdbf0c7671c tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f1448374820>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:55.997725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-5e16b176-1796-4820-a118-2fdbf0c7671c tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 200 len: 346 microversion: 2.1 time: 0.053375 Jun 07 16:04:55.998296 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 416/806] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 16:04:55 2022] GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:56.009548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-91810d11-fe7f-4539-87be-5ac6b3299f2f tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Action: 'create', calling method: .version_select at 0x7f144843b550>, body: {"snapshot": {"volume_id": "75f19944-7e97-472b-b189-560fa4934472", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-51820797"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:04:56.154417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-91810d11-fe7f-4539-87be-5ac6b3299f2f tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.148550 Jun 07 16:04:56.155026 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 391/807] 10.222.0.18 () {60 vars in 1161 bytes} [Tue Jun 7 16:04:56 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:56.165781 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cd2638ac-c22e-4e76-9b48-130e62ce8a28 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f14483d7a60>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:56.195709 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cd2638ac-c22e-4e76-9b48-130e62ce8a28 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 285 microversion: 2.1 time: 0.033684 Jun 07 16:04:56.196283 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 417/808] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:56 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:56.207186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-600ac2c3-623f-44d3-905c-dd2f8b2eb311 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144842aaf0>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:56.236525 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-600ac2c3-623f-44d3-905c-dd2f8b2eb311 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.034202 Jun 07 16:04:56.237087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 392/809] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Jun 7 16:04:56 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:56.246923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-83252346-6506-4bc8-a9c6-ff596ef1e68d tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f14483029d0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:56.279094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-83252346-6506-4bc8-a9c6-ff596ef1e68d tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 285 microversion: 2.1 time: 0.035663 Jun 07 16:04:56.279823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 418/810] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:56 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:56.759509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:56.760122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] [instance: 3def1191-4ee0-45d7-b43f-2e16de89e478] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:56.767849 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:56.768301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:56.769100 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:56.769541 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:56.783537 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] HTTP exception thrown: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Request method failure captured: Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 HTTP/1.1 Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3YB9jh1gsMMPbVQTbCCB5Izz7_yiT_tPNoot629O01IoH3v8Bh8YJxGDBUJ28g2gsesMcPhYLvwc9Vwm6pT1Uo2z4VMc8ymnTlTRGlK5bgpU3gPqqpaLeWHrwoRwZp-GvLvxnWlL22lcoR5e5K3BzRJS1tZk9YgfFkbNs1XtX1ps_A Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:04:56.785304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/960d9a6b1f514344aa82bbada2b878ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_960d9a6b1f514344aa82bbada2b878ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 960d9a6b1f514344aa82bbada2b878ca Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-582891739 Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: e9ca987fc23d4ff1a88dd4ed7b38980c Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-582891739-project Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. Jun 07 16:04:56.786996 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '3def1191-4ee0-45d7-b43f-2e16de89e478'} Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:04:56.787899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. Jun 07 16:04:56.789225 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:04:56.790546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] Returning 404 to user: Instance 3def1191-4ee0-45d7-b43f-2e16de89e478 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:04:56.790546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-05dd134e-b77c-4096-a0da-10a9a98b72c9 tempest-ServerRescueNegativeTestJSON-582891739 tempest-ServerRescueNegativeTestJSON-582891739-project] 10.222.0.18 "GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jun 07 16:04:56.792568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 393/811] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:04:56 2022] GET /compute/v2.1/servers/3def1191-4ee0-45d7-b43f-2e16de89e478 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:04:56.998997 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:57.000458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:57.006458 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:57.006919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:57.007692 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:57.008136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:57.088144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lazy-loading 'services' on Instance uuid 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:04:57.164268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-101eb697-f789-4f42-8c8e-b1e2dc07bbf6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments/8409b7a6-b15b-42a3-b29a-410812b34da4" status: 202 len: 0 microversion: 2.1 time: 0.169598 Jun 07 16:04:57.165146 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 419/812] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:04:56 2022] DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments/8409b7a6-b15b-42a3-b29a-410812b34da4 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:57.174360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:57.182970 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:57.190301 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:57.190796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:57.191582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:57.192050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:57.222392 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-991d95d6-5edb-402b-a744-d6fb8057df30 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052784 Jun 07 16:04:57.222959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 394/813] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:57 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:57.293393 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e0b30e11-5220-430d-aba1-3b6266ed8772 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f1448374c10>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:57.327199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e0b30e11-5220-430d-aba1-3b6266ed8772 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 285 microversion: 2.1 time: 0.038037 Jun 07 16:04:57.332289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 420/814] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:57 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 285 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:58.234376 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:58.235480 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:58.241909 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:58.242358 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:58.243122 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:58.243559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:58.275236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1a293e48-0c6a-4699-8c95-fde070253fed tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Jun 07 16:04:58.279601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 395/815] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:58 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:58.339653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-51578848-2464-47e0-81c2-54b230772475 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f1448302dc0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:58.370268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-51578848-2464-47e0-81c2-54b230772475 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 285 microversion: 2.1 time: 0.035046 Jun 07 16:04:58.370876 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 421/816] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:58 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:59.288490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:59.289466 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:04:59.296383 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:59.296827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:59.297816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:04:59.298251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:04:59.306702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:04:59.337641 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-755b1024-3b84-4ea9-a9d1-f4fab69df5eb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053048 Jun 07 16:04:59.341616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 396/817] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:04:59 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:59.385050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b50e2c38-9b88-4aa0-b55f-244721d769c9 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f14483caee0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:59.426679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b50e2c38-9b88-4aa0-b55f-244721d769c9 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 286 microversion: 2.1 time: 0.045577 Jun 07 16:04:59.427915 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 422/818] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:59 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:04:59.439411 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a6ce54b9-e9c9-4585-b4aa-a390c75dd649 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144835c940>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:59.534942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a6ce54b9-e9c9-4585-b4aa-a390c75dd649 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 202 len: 0 microversion: 2.1 time: 0.101045 Jun 07 16:04:59.535536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 397/819] 10.222.0.18 () {58 vars in 1253 bytes} [Tue Jun 7 16:04:59 2022] DELETE /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:04:59.544156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-55cd30f9-74b9-4ac9-ad76-316c44b1992a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f1448476820>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:04:59.577026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-55cd30f9-74b9-4ac9-ad76-316c44b1992a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 200 len: 285 microversion: 2.1 time: 0.037022 Jun 07 16:04:59.577858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 423/820] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:04:59 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:05:00.349349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.350318 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:00.356680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.357136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.357894 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.358330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.389337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-49f1bf03-18b3-46f5-b271-53ec4fa0f7d8 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044366 Jun 07 16:05:00.395041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 398/821] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:05:00 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:05:00.459342 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.459948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:00.462896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:00.467590 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.468096 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.468861 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.469293 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.495842 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:05:00.581004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7884d76d-0d7e-403d-b92c-55bd961087dc tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 204 len: 0 microversion: 2.1 time: 0.124919 Jun 07 16:05:00.581918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 424/822] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:00 2022] DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:05:00.589337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7724c65a-90c8-4700-b300-7b6cbceec137 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144842a5e0>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.590405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.591272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:00.598548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.599214 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.599426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:00.599861 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:00.615548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:00.616491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-7724c65a-90c8-4700-b300-7b6cbceec137 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] HTTP exception thrown: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7724c65a-90c8-4700-b300-7b6cbceec137 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Request method failure captured: Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 HTTP/1.1 Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3cmqyLYuyINTwqN1Q8hMz1-wV1_tFsfJPWa-Bw8Cm3IJ9X1tg1-6RP2c9Xd5EPP5_ZjCaPtXzeaa27MLrSKpwz-Nu2d-fCUit6b5xWOTqRKeIVO2tfEzm_VHrparIIQTqMhtki8t6J-nGMThB9VCJA40C4-DLm5lz8fGg5B0TKmNYk Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:00.618702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_433521f02a754082914aaf5fbe3d87cd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: bc1a154fdd7a431c8978a170dc2d68c9 Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14'} Jun 07 16:05:00.620240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. (HTTP 404) (Request-ID: req-b09c8704-701f-4c98-85f5-06a4e9f56cd8) Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.624913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:00.626230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 16:05:00.627603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7724c65a-90c8-4700-b300-7b6cbceec137 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Returning 404 to user: Snapshot 7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7724c65a-90c8-4700-b300-7b6cbceec137 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14" status: 404 len: 111 microversion: 2.1 time: 0.035553 Jun 07 16:05:00.629431 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 399/823] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:05:00 2022] GET /compute/v2.1/os-snapshots/7fa0e2a5-fe3b-4863-a5f5-3a75df1afe14 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:00.630841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7b1469b6-ee53-4656-9ec8-59e3c22fe360 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144857cdc0>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.695285 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7b1469b6-ee53-4656-9ec8-59e3c22fe360 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 202 len: 0 microversion: 2.1 time: 0.069748 Jun 07 16:05:00.699002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 400/824] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:05:00 2022] DELETE /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 16:05:00.705159 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ca19597c-ec6a-44af-b5da-0840d72306ff tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144835c820>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:00.760967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:00.765919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ca19597c-ec6a-44af-b5da-0840d72306ff tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 200 len: 345 microversion: 2.1 time: 0.065636 Jun 07 16:05:00.766475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 401/825] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 16:05:00 2022] GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:05:00.774037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e90ae7af-b679-4104-8c5a-3f9c34941df2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1678 microversion: 2.1 time: 0.187835 Jun 07 16:05:00.774621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 425/826] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:00 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:01.778650 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f687f284-2217-43d9-a28e-8987b4eb3512 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144857c670>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:01.792177 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:01.793424 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:01.800571 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:01.801392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:01.802374 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:01.803206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:01.824624 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-f687f284-2217-43d9-a28e-8987b4eb3512 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] HTTP exception thrown: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f687f284-2217-43d9-a28e-8987b4eb3512 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Request method failure captured: Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 HTTP/1.1 Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3cmqyLYuyINTwqN1Q8hMz1-wV1_tFsfJPWa-Bw8Cm3IJ9X1tg1-6RP2c9Xd5EPP5_ZjCaPtXzeaa27MLrSKpwz-Nu2d-fCUit6b5xWOTqRKeIVO2tfEzm_VHrparIIQTqMhtki8t6J-nGMThB9VCJA40C4-DLm5lz8fGg5B0TKmNYk Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:01.826751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_433521f02a754082914aaf5fbe3d87cd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: bc1a154fdd7a431c8978a170dc2d68c9 Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '75f19944-7e97-472b-b189-560fa4934472'} Jun 07 16:05:01.829434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. (HTTP 404) (Request-ID: req-54c12b93-965c-4b7d-8ba8-cf4da0cd4860) Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.831180 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:01.833410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 16:05:01.834923 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f687f284-2217-43d9-a28e-8987b4eb3512 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Returning 404 to user: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f687f284-2217-43d9-a28e-8987b4eb3512 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 404 len: 109 microversion: 2.1 time: 0.054421 Jun 07 16:05:01.836261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 402/827] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 16:05:01 2022] GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:01.859542 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8e5d3427-5046-4c55-98f4-92dd6272379a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f144857cc10>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:01.892557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-8e5d3427-5046-4c55-98f4-92dd6272379a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] HTTP exception thrown: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8e5d3427-5046-4c55-98f4-92dd6272379a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Request method failure captured: Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 HTTP/1.1 Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3cmqyLYuyINTwqN1Q8hMz1-wV1_tFsfJPWa-Bw8Cm3IJ9X1tg1-6RP2c9Xd5EPP5_ZjCaPtXzeaa27MLrSKpwz-Nu2d-fCUit6b5xWOTqRKeIVO2tfEzm_VHrparIIQTqMhtki8t6J-nGMThB9VCJA40C4-DLm5lz8fGg5B0TKmNYk Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:01.894559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_433521f02a754082914aaf5fbe3d87cd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: bc1a154fdd7a431c8978a170dc2d68c9 Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '75f19944-7e97-472b-b189-560fa4934472'} Jun 07 16:05:01.896230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. (HTTP 404) (Request-ID: req-00cd179c-a0b7-407d-b5a4-41bf471a9f30) Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.897315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 16:05:01.898744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 16:05:01.900067 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.901574 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.902345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8e5d3427-5046-4c55-98f4-92dd6272379a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Returning 404 to user: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:01.902600 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8e5d3427-5046-4c55-98f4-92dd6272379a tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 404 len: 109 microversion: 2.1 time: 0.051383 Jun 07 16:05:01.903548 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 403/828] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 7 16:05:01 2022] DELETE /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:05:01.912056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-60fd3b0c-5143-4e55-b921-564c1e4f33c5 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Calling method '.version_select at 0x7f14483d2280>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:01.942700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-60fd3b0c-5143-4e55-b921-564c1e4f33c5 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] HTTP exception thrown: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-60fd3b0c-5143-4e55-b921-564c1e4f33c5 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Request method failure captured: Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 HTTP/1.1 Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3cmqyLYuyINTwqN1Q8hMz1-wV1_tFsfJPWa-Bw8Cm3IJ9X1tg1-6RP2c9Xd5EPP5_ZjCaPtXzeaa27MLrSKpwz-Nu2d-fCUit6b5xWOTqRKeIVO2tfEzm_VHrparIIQTqMhtki8t6J-nGMThB9VCJA40C4-DLm5lz8fGg5B0TKmNYk Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:01.945459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/433521f02a754082914aaf5fbe3d87cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_433521f02a754082914aaf5fbe3d87cd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 433521f02a754082914aaf5fbe3d87cd Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-424215425 Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: bc1a154fdd7a431c8978a170dc2d68c9 Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-424215425-project Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '75f19944-7e97-472b-b189-560fa4934472'} Jun 07 16:05:01.947011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. (HTTP 404) (Request-ID: req-c952a30c-86f1-45ac-9243-5cfc71724b46) Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.947922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 16:05:01.949286 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 16:05:01.950566 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-60fd3b0c-5143-4e55-b921-564c1e4f33c5 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] Returning 404 to user: Volume 75f19944-7e97-472b-b189-560fa4934472 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-60fd3b0c-5143-4e55-b921-564c1e4f33c5 tempest-VolumesSnapshotsTestJSON-424215425 tempest-VolumesSnapshotsTestJSON-424215425-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472" status: 404 len: 109 microversion: 2.1 time: 0.039426 Jun 07 16:05:01.951881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 404/829] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 7 16:05:01 2022] GET /compute/v2.1/os-volumes/75f19944-7e97-472b-b189-560fa4934472 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:05:01.960212 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:01.968629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9305fcde-0d74-4cfe-844e-f00bec584fdf tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1678 microversion: 2.1 time: 0.180231 Jun 07 16:05:01.969734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 426/830] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:01 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:02.989368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:02.989947 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:02.997799 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:02.998807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:02.999720 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:03.000161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:03.081498 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47acc995d80476cbd4153e9121e97eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e601e41f827a4c6f8c743a174ac463fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:03.090529 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-21e81fc3-3252-4ade-a56b-235021bf6c16 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 200 len: 1611 microversion: 2.1 time: 0.107513 Jun 07 16:05:03.091502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 405/831] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:02 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 1611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:03.351490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-2305f0f2-b27b-4d09-8dec-a5772e7184da req-61c24dc1-fcb7-4b0c-a0e5-2530a7dfbaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3069cab6-3ca9-422f-a5b1-f95e5ee44d9b", "name": "network-vif-deleted", "tag": "9949b721-992d-4b54-bd2b-4b397867eeba"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:03.367270 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-2305f0f2-b27b-4d09-8dec-a5772e7184da req-61c24dc1-fcb7-4b0c-a0e5-2530a7dfbaaa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:03.367769 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-2305f0f2-b27b-4d09-8dec-a5772e7184da req-61c24dc1-fcb7-4b0c-a0e5-2530a7dfbaaa service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:03.384034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-2305f0f2-b27b-4d09-8dec-a5772e7184da req-61c24dc1-fcb7-4b0c-a0e5-2530a7dfbaaa service nova] Creating event network-vif-deleted:9949b721-992d-4b54-bd2b-4b397867eeba for instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b on hv-cinder-84487 Jun 07 16:05:03.393625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-2305f0f2-b27b-4d09-8dec-a5772e7184da req-61c24dc1-fcb7-4b0c-a0e5-2530a7dfbaaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046651 Jun 07 16:05:03.394405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 427/832] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:04.115978 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:04.117503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:04.128746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:04.129580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:04.130578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:04.131361 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:04.155803 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b HTTP/1.1 Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:04.164307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:04.166726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '3069cab6-3ca9-422f-a5b1-f95e5ee44d9b'} Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:04.167966 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:04.169848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:04.172531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:04.175735 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4e4074d7-b8f2-48f0-a089-1a2d33996fc2 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 404 len: 111 microversion: 2.1 time: 0.071329 Jun 07 16:05:04.179676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 406/833] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:04 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:04.187235 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7fbc2aa0-f603-4711-8f5f-f0f1f4353acb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '.version_select at 0x7f14483d7ee0>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:04.220730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7fbc2aa0-f603-4711-8f5f-f0f1f4353acb tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369268972" status: 202 len: 0 microversion: 2.1 time: 0.039564 Jun 07 16:05:04.221414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 428/834] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 7 16:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369268972 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:05:06.099872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:06.100512 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:06.108193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:06.108959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:06.109683 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:06.110110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:06.134537 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b HTTP/1.1 Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:06.138634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.140878 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '3069cab6-3ca9-422f-a5b1-f95e5ee44d9b'} Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:06.141852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.143276 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.156625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:06.156625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5d6b18da-1964-4452-a8e3-2306a15b57c9 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 404 len: 111 microversion: 2.1 time: 0.052127 Jun 07 16:05:06.156625 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 407/835] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:06 2022] DELETE /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:05:06.163640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:06.164440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:06.171452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:06.171919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:06.172751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:06.173189 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:06.187785 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b HTTP/1.1 Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:06.189452 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.191043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '3069cab6-3ca9-422f-a5b1-f95e5ee44d9b'} Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:06.191884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. Jun 07 16:05:06.193401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:06.194953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 3069cab6-3ca9-422f-a5b1-f95e5ee44d9b could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:06.194953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8ef135aa-320d-40f6-b69e-1897f845e23a tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b" status: 404 len: 111 microversion: 2.1 time: 0.031667 Jun 07 16:05:06.194953 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 429/836] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:06 2022] GET /compute/v2.1/servers/3069cab6-3ca9-422f-a5b1-f95e5ee44d9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:07.370389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:07.370906 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:07.379492 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.380145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.381020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.381551 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.400832 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f HTTP/1.1 Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:07.402248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.403565 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '68445d53-da9e-442d-93b8-0e70c601457f'} Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:07.407755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.409583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.411340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:07.411340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2ed058bf-c640-4948-9d28-85339546e506 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 404 len: 111 microversion: 2.1 time: 0.037619 Jun 07 16:05:07.411340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 408/837] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:07 2022] DELETE /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:07.412837 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:07.413640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 68445d53-da9e-442d-93b8-0e70c601457f] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:07.420578 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.422504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.423311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.423759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.438309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f HTTP/1.1 Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:07.439862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.441242 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '68445d53-da9e-442d-93b8-0e70c601457f'} Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:07.445690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. Jun 07 16:05:07.447183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.448252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 68445d53-da9e-442d-93b8-0e70c601457f could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:07.448252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-986fc91f-0aff-4c9c-868d-6a30ed4ac9a6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f" status: 404 len: 111 microversion: 2.1 time: 0.032783 Jun 07 16:05:07.448252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 430/838] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:07 2022] GET /compute/v2.1/servers/68445d53-da9e-442d-93b8-0e70c601457f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:07.450050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:07.450542 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:07.457333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.457781 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.458538 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.459143 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.476109 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d HTTP/1.1 Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:07.477722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.479132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '816146bc-5797-4984-a957-b06cd866439d'} Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:07.479866 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.482335 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.485378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:07.485378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-31d7d870-12ea-495c-9d52-c9ea171d0731 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 404 len: 111 microversion: 2.1 time: 0.032896 Jun 07 16:05:07.485378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 409/839] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:07 2022] DELETE /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:07.488826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:07.489437 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 816146bc-5797-4984-a957-b06cd866439d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:07.495431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.495882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.496845 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:07.497277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:07.512882 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d HTTP/1.1 Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:07.514520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.516143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '816146bc-5797-4984-a957-b06cd866439d'} Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:07.517144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. Jun 07 16:05:07.519108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:07.520625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 816146bc-5797-4984-a957-b06cd866439d could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:07.520625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-036de81c-0714-4bf4-a7b7-e2c9290d61e6 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d" status: 404 len: 111 microversion: 2.1 time: 0.032779 Jun 07 16:05:07.520625 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 431/840] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:07 2022] GET /compute/v2.1/servers/816146bc-5797-4984-a957-b06cd866439d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:08.684931 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:08.685514 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:08.692239 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:08.692724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:08.693490 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:08.693974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:08.708948 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b HTTP/1.1 Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:08.710491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.712068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '9edf7214-7bd8-479d-8d1b-1b8df84e7a0b'} Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:08.712885 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.714386 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.715759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:08.715759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ae16e65d-712a-4bb6-89f4-5426593e4405 tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jun 07 16:05:08.715759 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 410/841] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:08 2022] DELETE /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:08.720721 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:08.721346 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] [instance: 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:08.728024 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:08.728505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:08.729268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:08.729709 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:08.745547 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] HTTP exception thrown: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Request method failure captured: Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b HTTP/1.1 Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XJt15HnThr8t2CWHS22hjUh2IKpcZij9n24GSvBIU6ZOyIj2n7IGLDDW960oW-Z0zwDp28wQ9NH6k1X0aCtzVeLJaSleFgJjLAVQDZde6jqk60oH0fgpKkbpzp0c_G5Y-PwHGfmZ7F93qZh1XfcAPlGL3ku5SCIiY0S0vVZ7Rv80E Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:08.747076 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e601e41f827a4c6f8c743a174ac463fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e601e41f827a4c6f8c743a174ac463fa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: e601e41f827a4c6f8c743a174ac463fa Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-876599558 Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: f47acc995d80476cbd4153e9121e97eb Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeNegativeTest-876599558-project Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.748607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '9edf7214-7bd8-479d-8d1b-1b8df84e7a0b'} Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:08.750013 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. Jun 07 16:05:08.751165 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:08.752232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] Returning 404 to user: Instance 9edf7214-7bd8-479d-8d1b-1b8df84e7a0b could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:08.752232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7f70ebb9-b90f-4f82-bd62-45576ba070ab tempest-AttachVolumeNegativeTest-876599558 tempest-AttachVolumeNegativeTest-876599558-project] 10.222.0.18 "GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b" status: 404 len: 111 microversion: 2.1 time: 0.031944 Jun 07 16:05:08.752232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 432/842] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:08 2022] GET /compute/v2.1/servers/9edf7214-7bd8-479d-8d1b-1b8df84e7a0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:12.411889 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:12.412904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:12.426334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.426789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.427575 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.428011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.478718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c4d4675a-f2cc-4296-aabe-385723563b55 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084135 Jun 07 16:05:12.480302 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 411/843] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 7 16:05:12 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:12.569581 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:12.571123 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:12.580777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.582020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.584594 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.586281 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.631683 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:05:12.741726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8c872fdd-7a84-41ff-bb68-5ddbac32bd64 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 204 len: 0 microversion: 2.20 time: 0.176564 Jun 07 16:05:12.742632 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 433/844] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 7 16:05:12 2022] DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 16:05:12.751732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:12.752346 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:12.759059 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.759507 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.760271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:12.760807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:12.928598 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:12.939358 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:12.942518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:12.945035 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4d3cede3-a945-4ccb-8889-f01f82982d0d tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.198221 Jun 07 16:05:12.949531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 412/845] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:12 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 16:05:13.965063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:13.966602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:13.976483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:13.977194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:13.978281 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:13.978812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:14.142956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:14.152386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:14.154036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:14.175110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-56004bd1-8174-4158-b3b0-75585edca56e tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1723 microversion: 2.20 time: 0.214340 Jun 07 16:05:14.176558 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 434/846] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:13 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:05:15.196064 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:15.196654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:15.207114 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:15.207788 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:15.208603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:15.209473 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:15.300005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-8df78237-06a2-4651-8ce0-3edd807193ad req-24ef628e-8e1e-4797-ba5c-a6f69db26b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc", "name": "network-vif-deleted", "tag": "f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:15.309695 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-8df78237-06a2-4651-8ce0-3edd807193ad req-24ef628e-8e1e-4797-ba5c-a6f69db26b67 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:15.310479 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-8df78237-06a2-4651-8ce0-3edd807193ad req-24ef628e-8e1e-4797-ba5c-a6f69db26b67 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:15.348914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-8df78237-06a2-4651-8ce0-3edd807193ad req-24ef628e-8e1e-4797-ba5c-a6f69db26b67 service nova] Creating event network-vif-deleted:f6623e9e-f3e8-407a-b7e7-d0abdd63e8ff for instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc on hv-cinder-84487 Jun 07 16:05:15.365392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-8df78237-06a2-4651-8ce0-3edd807193ad req-24ef628e-8e1e-4797-ba5c-a6f69db26b67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069299 Jun 07 16:05:15.368942 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 435/847] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:15.634123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:15.642339 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:15.643839 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213a7f6737504f9eb89a2e51ddd639ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f6ff4cee09476c925730a31d32e56f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:15.645060 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-33e0fd8c-d66f-4a5e-b4e0-1e09a0fbb9c9 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 200 len: 1656 microversion: 2.20 time: 0.453431 Jun 07 16:05:15.645557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 413/848] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:15 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 1656 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 16:05:16.664089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:16.665469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:16.672695 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:16.673145 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:16.673917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:16.674356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:16.688285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc HTTP/1.1 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:16.690171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:16.691786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc'} Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:16.692783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:16.694800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:16.696320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:16.696320 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6e7ee1b4-087a-4b29-9880-1dac0e5c4e73 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 404 len: 111 microversion: 2.20 time: 0.032326 Jun 07 16:05:16.696682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 436/849] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:16 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:05:16.701619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4da43ba0-faad-4730-a630-eb545270fbfe tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '.version_select at 0x7f1448549c10>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:16.707724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:16.721011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4da43ba0-faad-4730-a630-eb545270fbfe tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-996795641" status: 204 len: 0 microversion: 2.20 time: 0.023228 Jun 07 16:05:16.724176 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 414/850] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Jun 7 16:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-996795641 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 16:05:18.513731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:18.514194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:18.521052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:18.521542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:18.522315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:18.522731 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:18.538648 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc HTTP/1.1 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:18.539377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.541239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc'} Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:18.541988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.543197 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.544345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:18.544345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-23ef7b4d-a67e-4863-b259-8efd4056ffb6 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 404 len: 111 microversion: 2.20 time: 0.031176 Jun 07 16:05:18.544345 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 437/851] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 7 16:05:18 2022] DELETE /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:05:18.551049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:18.551791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:18.558461 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:18.559025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:18.559876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:18.560307 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:18.573808 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc HTTP/1.1 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:18.575333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.577003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc'} Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:18.577850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. Jun 07 16:05:18.579363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:18.580649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:18.580649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-974ffed2-b616-4a46-bc05-77e5f7c4e6dd tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc" status: 404 len: 111 microversion: 2.20 time: 0.030244 Jun 07 16:05:18.580649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 415/852] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:18 2022] GET /compute/v2.1/servers/f2ef9fd5-edbe-4266-8b8c-b24976e4a2bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:05:19.723128 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:19.723620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:19.731327 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:19.732031 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:19.733143 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:19.734620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:19.750614 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 HTTP/1.1 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:19.752217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.753879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': 'a6d85f31-64e0-469b-ab5d-bb1534dc3889'} Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:19.754778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.756224 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.757688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:19.757688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-954a9eb2-5264-4cc7-ba9d-241c4c992f01 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 404 len: 111 microversion: 2.20 time: 0.036217 Jun 07 16:05:19.757688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 438/853] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 7 16:05:19 2022] DELETE /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:05:19.762236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:19.762848 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] [instance: a6d85f31-64e0-469b-ab5d-bb1534dc3889] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:19.769592 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:19.770087 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:19.770955 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:19.771396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:19.785769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] HTTP exception thrown: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Request method failure captured: Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 HTTP/1.1 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3XLn4HlDSfGBC-POUVNjLGN2gOJ5aeR5-M9Z3hObDi7XPPpZJ2UxS8D0VO0crPSquJHnZwKH2GoAIqlrWGfRYzc95laS0XYvIJZHGPvg9ZSLwFSqJDDyEcJ8DznRgXq35mXVj43nNJGvIm2vNqc9DxEUC6qSN7832JmfsQEtEwEzHU Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:05:19.787316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9f6ff4cee09476c925730a31d32e56f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9f6ff4cee09476c925730a31d32e56f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: d9f6ff4cee09476c925730a31d32e56f Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-363747201 Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 213a7f6737504f9eb89a2e51ddd639ff Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-363747201-project Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.789251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'a6d85f31-64e0-469b-ab5d-bb1534dc3889'} Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:19.790193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. Jun 07 16:05:19.791396 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:05:19.792502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] Returning 404 to user: Instance a6d85f31-64e0-469b-ab5d-bb1534dc3889 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:19.792502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ec8c1925-d149-44cb-9838-a81e37917158 tempest-AttachVolumeShelveTestJSON-363747201 tempest-AttachVolumeShelveTestJSON-363747201-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889" status: 404 len: 111 microversion: 2.20 time: 0.030311 Jun 07 16:05:19.792502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 416/854] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 7 16:05:19 2022] GET /compute/v2.1/servers/a6d85f31-64e0-469b-ab5d-bb1534dc3889 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 16:05:30.734163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-330010249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1550618767", "security_groups": [{"name": "tempest-secgroup-smoke-741234381"}], "block_device_mapping_v2": [{"uuid": "145b7740-a555-4c3a-9053-10ed520c2073", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5da0562-0cd6-4376-86ed-2ba23dbfe827"}]}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:30.743981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:30.744767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:31.017310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] validate_networks() for [('a5da0562-0cd6-4376-86ed-2ba23dbfe827', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:05:31.505669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:05:31.506099 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:05:31.506623 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:05:31.507044 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:05:31.507515 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:05:31.517090 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:31.517542 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:31.518337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:31.518780 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:31.537052 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:05:31.541457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Getting quotas for user c26cd29ec472479a9a36ac9bb1f05580 and project 44a1ab295b3a423aa2b3183a3e25ec0b. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:05:31.771776 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:05:31.773926 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='145b7740-a555-4c3a-9053-10ed520c2073',volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:05:31.964803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2b185cd1-338b-42c2-be94-805ed9305d2a tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.235435 Jun 07 16:05:31.965768 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 439/855] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:05:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:05:31.979077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9f78b371-6213-4016-9e68-b20a489503d5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:31.980555 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9f78b371-6213-4016-9e68-b20a489503d5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:31.988506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:31.989697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=49 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:32.056522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9f78b371-6213-4016-9e68-b20a489503d5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:32.067560 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9f78b371-6213-4016-9e68-b20a489503d5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1094 microversion: 2.1 time: 0.092503 Jun 07 16:05:32.068405 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 417/856] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:31 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:33.085040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:33.085580 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:33.092259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:33.093368 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:33.094129 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:33.094573 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:33.164474 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:33.172051 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-74aabf4d-a237-4278-960d-0adcb10d551f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1144 microversion: 2.1 time: 0.091457 Jun 07 16:05:33.172645 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 440/857] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:33 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:34.192132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:34.192774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:34.201360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:34.201850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:34.202619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:34.203048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:34.264197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:34.271942 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-0042b0fa-1065-43b6-b387-815daebb8acd tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1136 microversion: 2.1 time: 0.083740 Jun 07 16:05:34.283523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 418/858] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:34 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:35.290305 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:35.290960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:35.302943 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:35.303583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:35.304707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:35.305387 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:35.377700 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:35.385669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-be4b62c1-2f4f-4e19-bf18-a4c20ae53b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1136 microversion: 2.1 time: 0.099013 Jun 07 16:05:35.386338 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 441/859] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:35 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1136 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:36.403027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:36.403646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:36.411692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:36.412190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:36.413119 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:36.413583 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:36.493240 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:36.502744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d23d6cd5-b0d4-43fd-b243-89eb900d0116 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.103735 Jun 07 16:05:36.503317 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 419/860] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:36 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:37.519837 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:37.520549 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:37.527615 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.528326 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.529199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.529736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.611070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:37.620128 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dee97a1b-4f33-47e3-8072-453d71046102 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.104311 Jun 07 16:05:37.620964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 442/861] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:37 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:37.679778 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:37.687826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:37.701533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.701843 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.702795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.703235 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.761587 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:05:37.895360 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bd49606c-76b4-4eb0-8d77-247e338a16a1 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 204 len: 0 microversion: 2.1 time: 0.220242 Jun 07 16:05:37.896198 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 420/862] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:05:37 2022] DELETE /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:05:37.904703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:37.906048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:37.912930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.913981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.914957 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.915766 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.931270 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-78dd58f8-d293-4107-8ec9-48f940c866a3 req-0fbac7c7-3858-4003-8ea3-94e9460cf1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:37.946972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-78dd58f8-d293-4107-8ec9-48f940c866a3 req-0fbac7c7-3858-4003-8ea3-94e9460cf1d7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:37.947672 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-78dd58f8-d293-4107-8ec9-48f940c866a3 req-0fbac7c7-3858-4003-8ea3-94e9460cf1d7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:37.966844 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-78dd58f8-d293-4107-8ec9-48f940c866a3 req-0fbac7c7-3858-4003-8ea3-94e9460cf1d7 service nova] Creating event network-changed:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:05:37.976059 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-78dd58f8-d293-4107-8ec9-48f940c866a3 req-0fbac7c7-3858-4003-8ea3-94e9460cf1d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293868 Jun 07 16:05:37.977110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 443/863] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:38.081658 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:38.090953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7e518a55-732f-4deb-8cbf-b4c6f2caee62 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.190248 Jun 07 16:05:38.091860 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 421/864] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:37 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:38.639161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:38.640917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:38.660779 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:38.662651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:38.664217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:38.665134 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:38.743524 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:38.753222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e4eaf44f-d964-4c17-9c98-df1e5e926cbc tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.119285 Jun 07 16:05:38.753998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 444/865] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:38 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:39.108692 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:39.109320 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:39.115594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:39.116044 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:39.116856 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:39.117300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:39.253983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:39.261670 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-87cc5b56-b318-4127-931a-9501d9f8de9e tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.157130 Jun 07 16:05:39.262316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 422/866] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:39 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:39.770996 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:39.771842 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:39.778593 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:39.779385 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:39.780784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:39.781562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:39.846529 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:39.854217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-36eed644-6216-4d2b-b813-81202fc8b156 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.087428 Jun 07 16:05:39.854724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 445/867] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:39 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:40.278953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:40.279569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:40.286740 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:40.287208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:40.287972 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:40.288515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:40.426637 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:40.434233 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c45bba03-eb6f-482b-80de-1eb45a99dcf7 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.159215 Jun 07 16:05:40.434796 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 423/868] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:40 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:40.871856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:40.872693 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:40.879707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:40.880154 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:40.881054 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:40.881378 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:40.947914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:40.956010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-008cf0c5-44b9-4309-9d51-4c2069ef5cac tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.088892 Jun 07 16:05:40.956741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 446/869] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:40 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:41.451265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:41.452611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:41.459646 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:41.460097 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:41.460895 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:41.461336 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:41.626281 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:41.637345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-92a1ac8e-c984-4411-a7f2-dccca3c7d8cc tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.190082 Jun 07 16:05:41.638145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 424/870] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:41 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:41.974106 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:41.975294 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:41.978427 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:41.979258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:41.985191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:41.986120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:41.987156 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:41.987755 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:42.084819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:42.101897 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2539d5cc-22fe-4fa1-add9-460b38b0218b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1210 microversion: 2.1 time: 0.131739 Jun 07 16:05:42.103161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 447/871] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:41 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:42.658198 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:42.658827 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:42.660992 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:42.666811 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:42.667262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:42.668030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:42.668491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:43.120993 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:43.121852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:43.133764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:43.137502 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:43.138651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:43.140135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:43.403812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:43.420523 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6f7ddda5-8efe-4d19-a96a-83fafc372d85 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1569 microversion: 2.1 time: 0.766898 Jun 07 16:05:43.422116 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 425/872] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:42 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1569 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:43.632825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:43.641391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-659dd5d9-ccb4-4528-8c8c-539ed97bbe4c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.525209 Jun 07 16:05:43.642818 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 448/873] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:43 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:44.080181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-4ca84eb8-7c33-451a-a4fe-b13bf8edabc6 req-ff0fc03c-a7d2-466d-b700-2029a0eb3a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02aea574-14a9-41bc-8699-a5d3525a3390", "name": "network-vif-deleted", "tag": "ecee4301-3191-46a9-9f87-5b81919581bd"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:44.103148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4ca84eb8-7c33-451a-a4fe-b13bf8edabc6 req-ff0fc03c-a7d2-466d-b700-2029a0eb3a4e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:44.105056 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4ca84eb8-7c33-451a-a4fe-b13bf8edabc6 req-ff0fc03c-a7d2-466d-b700-2029a0eb3a4e service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:44.133629 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-4ca84eb8-7c33-451a-a4fe-b13bf8edabc6 req-ff0fc03c-a7d2-466d-b700-2029a0eb3a4e service nova] Creating event network-vif-deleted:ecee4301-3191-46a9-9f87-5b81919581bd for instance 02aea574-14a9-41bc-8699-a5d3525a3390 on hv-cinder-84487 Jun 07 16:05:44.141468 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-4ca84eb8-7c33-451a-a4fe-b13bf8edabc6 req-ff0fc03c-a7d2-466d-b700-2029a0eb3a4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071198 Jun 07 16:05:44.143533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 426/874] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:44.438640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:44.439252 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:44.449525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:44.464272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:44.468453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:44.469191 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:44.607617 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c98ae10605b4af1b367a28870919e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc2a18d64e440eabb0f4f4a072cf671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:44.622664 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a24b4e14-9bd8-4a08-ba0c-876d84bebf5b tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 200 len: 1218 microversion: 2.1 time: 0.187310 Jun 07 16:05:44.633395 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 449/875] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:44 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:44.668973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:44.670666 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:44.697349 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:44.698074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:44.700145 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:44.707046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:45.049477 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:45.059968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-31cbe611-649f-4a2f-8e25-ee8c9251c685 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.400451 Jun 07 16:05:45.062420 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 427/876] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:44 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:45.643234 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:45.643915 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] [instance: 02aea574-14a9-41bc-8699-a5d3525a3390] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:45.651744 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:45.652207 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:45.653204 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:45.653503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:45.668299 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] HTTP exception thrown: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Request method failure captured: Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 HTTP/1.1 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3YPSLRl7anLD7npLPcAUmNp0LxqZk3fIqFEORFyK7oAJN6Ej6RGT0sAkmi0IXEZoV1-ZO3KItp3pHkBSP6mSlGubBauwC2D65kPOaZp8iefLl9bRqGxyXOVsJOb_Oq7jCa0IB74BuJZVn-nwLvVA6uhlw2ERg5Ikt58Bgzp2S5eOl8 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 8bc2a18d64e440eabb0f4f4a072cf671 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestShelveInstance-142630982 Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:05:45.670005 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bc2a18d64e440eabb0f4f4a072cf671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8bc2a18d64e440eabb0f4f4a072cf671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8bc2a18d64e440eabb0f4f4a072cf671"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8bc2a18d64e440eabb0f4f4a072cf671", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestShelveInstance-142630982 Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 8bc2a18d64e440eabb0f4f4a072cf671 Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestShelveInstance-142630982 Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestShelveInstance-142630982-project Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: 5c98ae10605b4af1b367a28870919e47 Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestShelveInstance-142630982-project Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. Jun 07 16:05:45.671937 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '02aea574-14a9-41bc-8699-a5d3525a3390'} Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:05:45.672778 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. Jun 07 16:05:45.674028 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:05:45.675208 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Returning 404 to user: Instance 02aea574-14a9-41bc-8699-a5d3525a3390 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:05:45.675208 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c049f861-3f27-4964-b0e8-3f91d06a7232 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390" status: 404 len: 111 microversion: 2.1 time: 0.033411 Jun 07 16:05:45.675208 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 450/877] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:45 2022] GET /compute/v2.1/servers/02aea574-14a9-41bc-8699-a5d3525a3390 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:05:45.861783 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-38eeb349-02a7-4def-a1a3-4a3254b98cc0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] Calling method '.version_select at 0x7f144848d1f0>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:45.897502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-38eeb349-02a7-4def-a1a3-4a3254b98cc0 tempest-TestShelveInstance-142630982 tempest-TestShelveInstance-142630982-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-216541568" status: 202 len: 0 microversion: 2.1 time: 0.038652 Jun 07 16:05:45.898456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 428/878] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 7 16:05:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-216541568 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:05:46.081514 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:46.082230 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:46.089151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:46.089683 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:46.090930 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:46.091520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:46.195329 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-218b91bf-1b10-4267-9aec-c5aee935ed36 req-5c059d56-cdb1-46f7-b78c-fdea6961fe48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ada36d-b4a9-4183-b872-8810804ff83d", "tag": "764822f5-eb58-4c69-86cf-5133a4e4dddf"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:46.205460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-218b91bf-1b10-4267-9aec-c5aee935ed36 req-5c059d56-cdb1-46f7-b78c-fdea6961fe48 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:46.206375 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-218b91bf-1b10-4267-9aec-c5aee935ed36 req-5c059d56-cdb1-46f7-b78c-fdea6961fe48 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:46.220179 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-218b91bf-1b10-4267-9aec-c5aee935ed36 req-5c059d56-cdb1-46f7-b78c-fdea6961fe48 service nova] Creating event network-changed:764822f5-eb58-4c69-86cf-5133a4e4dddf for instance e8ada36d-b4a9-4183-b872-8810804ff83d on hv-cinder-84487 Jun 07 16:05:46.226297 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-218b91bf-1b10-4267-9aec-c5aee935ed36 req-5c059d56-cdb1-46f7-b78c-fdea6961fe48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Jun 07 16:05:46.227769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 429/879] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:46.445310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:46.458363 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-36692d34-f7f2-41b7-8c3b-889ac42eb50d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.382854 Jun 07 16:05:46.459852 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 451/880] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:46 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:05:47.478762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:47.480207 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:47.490101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:47.490710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:47.491609 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:47.492037 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:47.767325 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:47.774977 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-15f7260a-15e1-4821-ac97-875671d704fe tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.302314 Jun 07 16:05:47.775748 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 430/881] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:47 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:48.792834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:48.793616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:48.806245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:48.807601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:48.809365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:48.810042 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:49.073628 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:49.085986 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a4d68108-3df6-4208-b29a-72496b468019 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.296911 Jun 07 16:05:49.089569 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 452/882] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:48 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:50.107384 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:50.108034 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:50.114533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:50.114995 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:50.115760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:50.116395 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:50.373062 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:50.385825 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-80dbe324-8101-4bbb-9280-da2ef0478f98 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.282775 Jun 07 16:05:50.386511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 431/883] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:50 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:51.402822 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:51.403450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:51.411819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:51.412283 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:51.413325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:51.413688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:51.584803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:51.593638 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-90e237ae-a5f8-4984-9e67-7abcebfc0c0f tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.194320 Jun 07 16:05:51.594651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 453/884] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:51 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:52.611933 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:52.612674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:52.628206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:52.630376 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:52.631343 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:52.631851 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:52.786564 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:52.795337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-65bab6c2-2eb1-49e6-a26c-c3d6c4a972c5 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.188357 Jun 07 16:05:52.804666 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 432/885] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:52 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:53.811684 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:53.812963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:53.821675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:53.821675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:53.821675 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:53.821972 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:53.987913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:54.003214 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-af0f5701-8757-4d8d-96fc-79b203b62115 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.196027 Jun 07 16:05:54.003906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 454/886] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:53 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:55.021078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:55.021697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:55.028092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:55.028570 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:55.029665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:55.030101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:55.207918 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:55.221952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-326b21ae-199f-441c-ac9f-2206fd341ba2 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.204673 Jun 07 16:05:55.222934 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 433/887] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:55 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:56.251045 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:56.253730 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:56.266303 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:56.267384 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:56.268500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:56.269291 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:56.530133 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:56.539421 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-16b0d296-456c-4f83-9bf7-c80236d0c9ab tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.304986 Jun 07 16:05:56.550027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 455/888] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:56 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:56.834875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-a74c9e7b-a36a-4148-934a-67c27c93d1b2 req-5c0db823-7c2b-43f3-b26c-f0fd9e7b4678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ada36d-b4a9-4183-b872-8810804ff83d", "name": "network-vif-plugged", "status": "completed", "tag": "764822f5-eb58-4c69-86cf-5133a4e4dddf"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:05:56.859528 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-a74c9e7b-a36a-4148-934a-67c27c93d1b2 req-5c0db823-7c2b-43f3-b26c-f0fd9e7b4678 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:56.859992 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-a74c9e7b-a36a-4148-934a-67c27c93d1b2 req-5c0db823-7c2b-43f3-b26c-f0fd9e7b4678 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:56.878167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-a74c9e7b-a36a-4148-934a-67c27c93d1b2 req-5c0db823-7c2b-43f3-b26c-f0fd9e7b4678 service nova] Creating event network-vif-plugged:764822f5-eb58-4c69-86cf-5133a4e4dddf for instance e8ada36d-b4a9-4183-b872-8810804ff83d on hv-cinder-84487 Jun 07 16:05:56.885107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-a74c9e7b-a36a-4148-934a-67c27c93d1b2 req-5c0db823-7c2b-43f3-b26c-f0fd9e7b4678 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054326 Jun 07 16:05:56.886142 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 434/889] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:05:57.558585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:57.559335 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:57.568187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:57.568685 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:57.569624 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:57.570066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:57.719615 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:57.730887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6c7c6ca4-cac3-49b5-b4d1-153400bc9fcb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.176883 Jun 07 16:05:57.732102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 456/890] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:57 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:58.750710 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:58.752230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:58.759560 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:58.760003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:58.760795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:58.761475 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:58.923549 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:05:58.931197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:05:58.936561 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b8087737-af16-4c19-bc14-ca8a378508b3 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.191280 Jun 07 16:05:58.937223 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 435/891] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:58 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:05:59.954258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:05:59.955427 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:05:59.965635 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:59.966107 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:59.967699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:05:59.968576 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:05:59.992800 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=100 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:00.113473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:00.121017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-295218cf-fd5a-4cee-a14c-9b97d9be8229 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1265 microversion: 2.1 time: 0.171626 Jun 07 16:06:00.121577 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 457/892] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:05:59 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:01.140288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:01.140288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:01.150695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:01.150695 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:01.150993 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:01.153732 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:01.334614 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:01.345413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-48a602ea-261f-43c6-bffd-02794f490363 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1453 microversion: 2.1 time: 0.211374 Jun 07 16:06:01.346400 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 436/893] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:01 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:01.362506 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:01.364504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:01.373803 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:01.375583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:01.376615 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:01.377425 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:01.377874 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:01.544110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:01.548233 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e6ba6162-81d2-4055-8391-db3dd944f6af tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1453 microversion: 2.1 time: 0.190541 Jun 07 16:06:01.548837 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 458/894] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:01 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:03.434852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-2641da9a-0a99-4fb1-91ed-7614c38c65ef req-d8bfc498-ebb5-445c-8b73-c51fc647be45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ada36d-b4a9-4183-b872-8810804ff83d", "tag": "764822f5-eb58-4c69-86cf-5133a4e4dddf"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:03.448292 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:03.451152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2641da9a-0a99-4fb1-91ed-7614c38c65ef req-d8bfc498-ebb5-445c-8b73-c51fc647be45 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:03.452633 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2641da9a-0a99-4fb1-91ed-7614c38c65ef req-d8bfc498-ebb5-445c-8b73-c51fc647be45 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:03.470099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-2641da9a-0a99-4fb1-91ed-7614c38c65ef req-d8bfc498-ebb5-445c-8b73-c51fc647be45 service nova] Creating event network-changed:764822f5-eb58-4c69-86cf-5133a4e4dddf for instance e8ada36d-b4a9-4183-b872-8810804ff83d on hv-cinder-84487 Jun 07 16:06:03.476181 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-2641da9a-0a99-4fb1-91ed-7614c38c65ef req-d8bfc498-ebb5-445c-8b73-c51fc647be45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047751 Jun 07 16:06:03.476992 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 437/895] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:06:11.392425 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1327983389", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "networks": [{"uuid": "bf4468c2-04cd-4401-baaa-a3a198a16dac"}]}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:11.470085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] validate_networks() for [('bf4468c2-04cd-4401-baaa-a3a198a16dac', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:06:11.544379 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=8 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:11.842737 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:06:11.843159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:06:11.843629 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:06:11.844065 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:06:11.844511 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:06:11.854199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:11.854643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:11.855489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:11.855960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:11.875599 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Getting quotas for project aad305bb9275482b95b858fa3669e8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:06:11.880017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Getting quotas for user 4244e60b4d424bf29575b8214aadde9a and project aad305bb9275482b95b858fa3669e8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:06:11.890958 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:06:11.893248 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:06:11.939131 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-30e2fd45-6e83-4834-8f7d-91bcd28c8519 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551445 Jun 07 16:06:11.944520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 459/896] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:06:11.950694 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b512eef-6b2b-4475-9e9a-d05ed09c6b5a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:11.951919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8b512eef-6b2b-4475-9e9a-d05ed09c6b5a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:12.013217 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8b512eef-6b2b-4475-9e9a-d05ed09c6b5a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:12.020455 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8b512eef-6b2b-4475-9e9a-d05ed09c6b5a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1214 microversion: 2.1 time: 0.074456 Jun 07 16:06:12.021026 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 438/897] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:11 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:06:13.038144 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:13.038806 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:13.045516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:13.045965 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:13.046807 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:13.047241 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:13.109966 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:13.117695 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ef137039-07b9-4721-901e-2a40e6f3f584 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1218 microversion: 2.1 time: 0.083872 Jun 07 16:06:13.118258 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 460/898] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:13 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:14.135289 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:14.136505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:14.139009 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=8 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:14.145557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:14.146004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:14.146763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:14.147200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:14.209854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:14.217300 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ae31f3ba-881e-4109-8c2b-ce9f3ac02e72 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1218 microversion: 2.1 time: 0.086005 Jun 07 16:06:14.217863 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 439/899] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:14 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:15.235047 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:15.235826 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:15.242739 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:15.243193 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:15.244002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:15.244473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:15.307217 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:15.315171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7791e13c-a1d2-458e-ad35-602ed1563162 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1266 microversion: 2.1 time: 0.084498 Jun 07 16:06:15.315799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 461/900] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:15 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:06:16.333701 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:16.334505 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:16.341540 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:16.341991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:16.342756 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:16.343191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:16.406079 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:16.413626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-71fe9c24-129f-4b1c-b381-ea620e651cc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1274 microversion: 2.1 time: 0.084418 Jun 07 16:06:16.414193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 440/901] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:16 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:17.430555 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:17.431192 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:17.437651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:17.438473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:17.438860 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:17.439294 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:17.505671 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:17.513050 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-803beeb0-b85d-4d61-9693-debf5e33dcff tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1284 microversion: 2.1 time: 0.086447 Jun 07 16:06:17.513620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 462/902] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:17 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:18.531021 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:18.531561 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:18.538998 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:18.539445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:18.540208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:18.540668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:18.605148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:18.613340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1ef19a08-9fb9-4b88-ae86-261e6500b838 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1284 microversion: 2.1 time: 0.086277 Jun 07 16:06:18.613899 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 441/903] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:18 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:19.630102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:19.630655 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:19.637216 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:19.637670 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:19.638435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:19.638878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:19.770268 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:19.777699 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-37f53963-a8c3-4721-9865-351fe799c2d0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.151805 Jun 07 16:06:19.778262 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 463/904] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:19 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:20.794994 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:20.795634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:20.802659 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:20.803111 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:20.803881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:20.804369 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:21.003109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-aeb0b725-caf9-4e7b-8ecd-f1c2b647d522 req-cdf8d15b-df08-4b40-8173-9a810c3e44e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19768408-2375-4de7-94b0-45c128dfed33", "tag": "9d8ba07f-4c4b-4976-8bfc-9f0332df2645"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:21.012604 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-aeb0b725-caf9-4e7b-8ecd-f1c2b647d522 req-cdf8d15b-df08-4b40-8173-9a810c3e44e7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:21.013271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-aeb0b725-caf9-4e7b-8ecd-f1c2b647d522 req-cdf8d15b-df08-4b40-8173-9a810c3e44e7 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:21.025688 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-aeb0b725-caf9-4e7b-8ecd-f1c2b647d522 req-cdf8d15b-df08-4b40-8173-9a810c3e44e7 service nova] Creating event network-changed:9d8ba07f-4c4b-4976-8bfc-9f0332df2645 for instance 19768408-2375-4de7-94b0-45c128dfed33 on hv-cinder-84487 Jun 07 16:06:21.027518 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:21.035850 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5acc08f1-ad96-4415-868e-f2969dde984b tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.244388 Jun 07 16:06:21.036661 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 442/905] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:20 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:21.038384 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-aeb0b725-caf9-4e7b-8ecd-f1c2b647d522 req-cdf8d15b-df08-4b40-8173-9a810c3e44e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038810 Jun 07 16:06:21.039315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 464/906] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:06:22.054792 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:22.055414 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:22.059018 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:22.063296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:22.063733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:22.064526 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:22.064965 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:22.287771 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:22.296308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9614b409-53b1-462f-a685-94ac52599847 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.246006 Jun 07 16:06:22.305677 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 443/907] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:22 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:23.314728 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:23.317211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:23.319455 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:23.320151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:23.327380 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:23.328035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:23.328811 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:23.329282 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:23.476172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:23.484102 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f9db2034-6a4e-4a24-9d09-09256e140bc3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.174426 Jun 07 16:06:23.484715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 465/908] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:23 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:24.500137 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:24.500779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:24.508074 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:24.508577 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:24.509340 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:24.509779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:24.645580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:24.653161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-34b8fd87-b9a8-4574-8cda-a0bebacdc62a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.156866 Jun 07 16:06:24.653734 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 444/909] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:24 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:25.670110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:25.670755 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:25.677687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:25.678136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:25.678901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:25.679334 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:25.804499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:25.811759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8de5d93f-5541-4f97-93c1-c6c24f1d146e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.145491 Jun 07 16:06:25.812325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 466/910] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:25 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:26.828961 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:26.829573 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:26.836503 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:26.836952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:26.837704 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:26.838136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:26.969374 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:26.977010 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8454a866-1784-44f2-add2-3e8653c60f5e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.151916 Jun 07 16:06:26.977580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 445/911] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:26 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:27.994644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:27.995389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:28.002909 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:28.003503 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:28.004554 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:28.004990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:28.147767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:28.155246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-0156a647-b8ec-425a-8aad-a5543954e53a tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.164522 Jun 07 16:06:28.155835 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 467/912] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:27 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:28.921773 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-7767d2e0-3389-415d-a7b8-ad1c8f0be789 req-e7351da5-9da8-4035-812c-310424847d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19768408-2375-4de7-94b0-45c128dfed33", "name": "network-vif-plugged", "status": "completed", "tag": "9d8ba07f-4c4b-4976-8bfc-9f0332df2645"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:28.934638 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-7767d2e0-3389-415d-a7b8-ad1c8f0be789 req-e7351da5-9da8-4035-812c-310424847d7c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:28.935858 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-7767d2e0-3389-415d-a7b8-ad1c8f0be789 req-e7351da5-9da8-4035-812c-310424847d7c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:28.954428 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-7767d2e0-3389-415d-a7b8-ad1c8f0be789 req-e7351da5-9da8-4035-812c-310424847d7c service nova] Creating event network-vif-plugged:9d8ba07f-4c4b-4976-8bfc-9f0332df2645 for instance 19768408-2375-4de7-94b0-45c128dfed33 on hv-cinder-84487 Jun 07 16:06:28.960210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-7767d2e0-3389-415d-a7b8-ad1c8f0be789 req-e7351da5-9da8-4035-812c-310424847d7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042658 Jun 07 16:06:28.961050 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 446/913] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:06:29.172786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:29.173850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:29.181359 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:29.182135 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:29.183944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:29.184706 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:29.381717 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:29.390100 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a4cf38d8-f64d-40ab-a639-0211a956dbc9 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.221638 Jun 07 16:06:29.390819 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 468/914] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:29 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:30.408383 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:30.409134 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:30.416578 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:30.417032 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:30.417782 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:30.418209 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:30.558873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:30.566529 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-983a8fd7-9357-447d-839b-e60abe1ae6ac tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1314 microversion: 2.1 time: 0.162762 Jun 07 16:06:30.567133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 447/915] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:30 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:31.583097 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:31.584685 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:31.588416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:31.592932 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:31.593583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:31.594717 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:31.595227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:31.749104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:31.754212 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-10f32469-702b-4784-bd7e-8acaca44bbd0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1498 microversion: 2.1 time: 0.175009 Jun 07 16:06:31.755048 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 469/916] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:31 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:35.581167 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:35.581679 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:35.584460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=24 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:35.589911 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:35.590362 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:35.591126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:35.591562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:35.617442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:06:35.692148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-5884ee2d-74c9-4b91-a5ce-046c35df18c2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 204 len: 0 microversion: 2.1 time: 0.114393 Jun 07 16:06:35.692657 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 448/917] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:06:35 2022] DELETE /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:06:35.701472 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:35.702174 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:35.710280 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:35.710727 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:35.711489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:35.711924 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:35.842478 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:35.850376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-76f1ff0f-6150-41cd-8518-f998bb6c4db7 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1504 microversion: 2.1 time: 0.153012 Jun 07 16:06:35.850936 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 470/918] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:35 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:36.868292 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:36.868922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:36.876076 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:36.876559 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:36.877313 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:36.877745 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:37.007991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:37.015495 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6ff71c98-a76b-4781-8e20-b4fc80c95b6c tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1504 microversion: 2.1 time: 0.151482 Jun 07 16:06:37.016078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 449/919] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:36 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:37.980805 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-211b3507-516a-4157-8032-05bda949f7f2 req-d70a4a0a-0b29-4526-97c5-84868fd5d587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19768408-2375-4de7-94b0-45c128dfed33", "name": "network-vif-deleted", "tag": "9d8ba07f-4c4b-4976-8bfc-9f0332df2645"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:37.992454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-211b3507-516a-4157-8032-05bda949f7f2 req-d70a4a0a-0b29-4526-97c5-84868fd5d587 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:37.992905 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-211b3507-516a-4157-8032-05bda949f7f2 req-d70a4a0a-0b29-4526-97c5-84868fd5d587 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:38.005757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-211b3507-516a-4157-8032-05bda949f7f2 req-d70a4a0a-0b29-4526-97c5-84868fd5d587 service nova] Creating event network-vif-deleted:9d8ba07f-4c4b-4976-8bfc-9f0332df2645 for instance 19768408-2375-4de7-94b0-45c128dfed33 on hv-cinder-84487 Jun 07 16:06:38.011715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-211b3507-516a-4157-8032-05bda949f7f2 req-d70a4a0a-0b29-4526-97c5-84868fd5d587 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Jun 07 16:06:38.012470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 471/920] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:06:38.032987 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:38.033930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:38.041590 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:38.042041 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:38.042815 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:38.043260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:38.109828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:38.118130 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-49c4ad2f-3485-4249-8c1f-ab0fcbfa04a6 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1462 microversion: 2.1 time: 0.089315 Jun 07 16:06:38.118715 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 450/921] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:38 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:39.137441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:39.138104 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:39.144383 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:39.145462 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:39.146380 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:39.146823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:39.209021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:39.216720 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-07aa182e-d28e-4b5c-ab19-9996125fac94 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1299 microversion: 2.1 time: 0.084159 Jun 07 16:06:39.217284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 472/922] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:39 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:40.234304 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:40.234911 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:40.241389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:40.241836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:40.242585 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:40.243016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:40.305183 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:40.312538 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-790729a5-e324-46c4-a2af-7d7c931a9491 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1299 microversion: 2.1 time: 0.082709 Jun 07 16:06:40.313099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 451/923] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:40 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:41.329398 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:41.330017 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:41.337553 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:41.338002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:41.338794 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:41.339228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:41.373212 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:41.373759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:41.374204 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lazy-loading 'fault' on Instance uuid 19768408-2375-4de7-94b0-45c128dfed33 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:06:41.422418 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:41.429572 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cd1b7ae3-5f37-4abc-9448-f604652a698d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 200 len: 1304 microversion: 2.1 time: 0.104129 Jun 07 16:06:41.430148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 473/924] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:41 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:42.449499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:42.450111 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 19768408-2375-4de7-94b0-45c128dfed33] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:42.457872 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:42.458512 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:42.459255 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:42.459686 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:42.473586 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] HTTP exception thrown: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Request method failure captured: Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 HTTP/1.1 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3dvaaaEttaVaU-sfCcMLIuL4KS4lJQgxhWyJUXYAeXiiB5yuAHtsW9TcGUTJpMjJVuXnUw07CnLgFfIPt7V62GG9nucScGeQme0UeGFP1CtLVP2q5xB5z_V1fkZp6DJGAuIjLecRidLPKfJSQ6kyU8PU0dL22v-GdD-1xcQMNOndXA Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: aad305bb9275482b95b858fa3669e8e9 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesActionsTest-2092477073 Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:06:42.475248 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aad305bb9275482b95b858fa3669e8e9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesActionsTest-2092477073 Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: aad305bb9275482b95b858fa3669e8e9 Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesActionsTest-2092477073 Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesActionsTest-2092477073-project Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 4244e60b4d424bf29575b8214aadde9a Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesActionsTest-2092477073-project Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. Jun 07 16:06:42.476967 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '19768408-2375-4de7-94b0-45c128dfed33'} Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:06:42.477812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. Jun 07 16:06:42.479208 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:06:42.480415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Returning 404 to user: Instance 19768408-2375-4de7-94b0-45c128dfed33 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:06:42.480415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-efa0d49d-5721-4cd4-80a3-ecab5a2e0725 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33" status: 404 len: 111 microversion: 2.1 time: 0.034016 Jun 07 16:06:42.480415 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 452/925] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:42 2022] GET /compute/v2.1/servers/19768408-2375-4de7-94b0-45c128dfed33 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:06:42.572381 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1964032352", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "networks": [{"uuid": "bf4468c2-04cd-4401-baaa-a3a198a16dac"}]}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:42.623657 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.network.neutron [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] validate_networks() for [('bf4468c2-04cd-4401-baaa-a3a198a16dac', None, None, None, None, None)] {{(pid=117818) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:06:42.965855 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Flavor limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:06:42.966370 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Image limits 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:06:42.966750 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Flavor pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:06:42.967167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Image pref 0:0:0 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:06:42.967582 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.virt.hardware [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:06:42.977107 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:42.977490 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:42.978290 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:42.978726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:42.985637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=81 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:42.997157 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Getting quotas for project aad305bb9275482b95b858fa3669e8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:06:43.001118 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Getting quotas for user 4244e60b4d424bf29575b8214aadde9a and project aad305bb9275482b95b858fa3669e8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:06:43.012150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Going to run 1 instances... {{(pid=117818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:06:43.014414 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:06:43.058322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9d32d77c-94e2-4fb3-89e3-2ab3ce9d9aa3 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489795 Jun 07 16:06:43.058967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 474/926] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:06:43.068943 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1594c841-f912-4d29-92a0-e79c70ff31bc tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:43.069558 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1594c841-f912-4d29-92a0-e79c70ff31bc tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:43.123027 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1594c841-f912-4d29-92a0-e79c70ff31bc tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:43.135393 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1594c841-f912-4d29-92a0-e79c70ff31bc tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1214 microversion: 2.1 time: 0.070302 Jun 07 16:06:43.135875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 453/927] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:43 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:06:44.152689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:44.153315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:44.160487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:44.161059 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:44.161910 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:44.162402 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:44.224373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:44.231741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-021766a9-4a9c-4a6d-95b1-24ac68e1b286 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1218 microversion: 2.1 time: 0.083540 Jun 07 16:06:44.232620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 475/928] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:44 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:45.249940 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:45.250654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:45.258110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:45.259281 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:45.260243 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:45.260722 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:45.263471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:45.330739 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:45.338296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-1e159ac0-8b3f-45ba-a9f3-4b3484ec080e tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1266 microversion: 2.1 time: 0.092784 Jun 07 16:06:45.338865 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 454/929] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:45 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:46.354866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:46.355483 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:46.363219 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:46.364298 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:46.365131 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:46.365601 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:46.600061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:46.608140 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-ae8319f3-0da2-49a4-8fc6-02811c2b2339 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.257215 Jun 07 16:06:46.608745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 476/930] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:46 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:47.021755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-d924c66f-ec36-4118-8535-316912e12b4b req-4baca689-69b8-43b7-889e-353aa253967c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49779b06-5543-4125-8d9e-f0b9fa78015e", "tag": "44620ff1-b162-4cc0-9379-ec079c59e72f"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:47.030852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d924c66f-ec36-4118-8535-316912e12b4b req-4baca689-69b8-43b7-889e-353aa253967c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:47.031533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-d924c66f-ec36-4118-8535-316912e12b4b req-4baca689-69b8-43b7-889e-353aa253967c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:47.047151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-d924c66f-ec36-4118-8535-316912e12b4b req-4baca689-69b8-43b7-889e-353aa253967c service nova] Creating event network-changed:44620ff1-b162-4cc0-9379-ec079c59e72f for instance 49779b06-5543-4125-8d9e-f0b9fa78015e on hv-cinder-84487 Jun 07 16:06:47.051959 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-d924c66f-ec36-4118-8535-316912e12b4b req-4baca689-69b8-43b7-889e-353aa253967c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034429 Jun 07 16:06:47.052595 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 455/931] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:06:47.627901 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:47.630496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:47.638272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:47.638759 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:47.639537 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:47.639976 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:47.812847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:47.821902 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-669a6784-d6cb-4361-a930-9706229d70de tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.198277 Jun 07 16:06:47.822562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 477/932] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:47 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:48.841744 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:48.842487 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:48.852751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:48.853204 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:48.854656 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:48.855474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:49.102416 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:49.111697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-55e02ee7-1e19-4d8b-95b5-62d62ff32804 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.276077 Jun 07 16:06:49.112269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 456/933] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:48 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:50.128950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:50.129663 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:50.136200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:50.136971 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:50.138114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:50.138667 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:50.281735 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:50.289347 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-a0a8e850-9b9f-4230-a432-2665b2f4221d tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.164432 Jun 07 16:06:50.290006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 478/934] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:50 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:51.307626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:51.308264 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:51.315173 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:51.315621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:51.316589 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:51.317036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:51.462190 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:51.471077 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-921f9836-0de3-47bd-a7e2-2a0aeae7338f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.167275 Jun 07 16:06:51.471831 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 457/935] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:51 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:06:52.489374 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:52.491263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:52.500789 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:52.502431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:52.504724 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:52.505402 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:52.673399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:52.683481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-23d2c9f1-7397-42e5-9354-2c6770e8a707 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.198107 Jun 07 16:06:52.684496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 479/936] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:52 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:53.308464 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-5a999b3d-ffea-4803-a357-d15674c14ae2 req-02f15292-89ac-47f3-a1b8-e87886b790ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49779b06-5543-4125-8d9e-f0b9fa78015e", "name": "network-vif-plugged", "status": "completed", "tag": "44620ff1-b162-4cc0-9379-ec079c59e72f"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:53.313434 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:53.321557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-5a999b3d-ffea-4803-a357-d15674c14ae2 req-02f15292-89ac-47f3-a1b8-e87886b790ed service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:53.322449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-5a999b3d-ffea-4803-a357-d15674c14ae2 req-02f15292-89ac-47f3-a1b8-e87886b790ed service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:53.337780 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-5a999b3d-ffea-4803-a357-d15674c14ae2 req-02f15292-89ac-47f3-a1b8-e87886b790ed service nova] Creating event network-vif-plugged:44620ff1-b162-4cc0-9379-ec079c59e72f for instance 49779b06-5543-4125-8d9e-f0b9fa78015e on hv-cinder-84487 Jun 07 16:06:53.345806 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-5a999b3d-ffea-4803-a357-d15674c14ae2 req-02f15292-89ac-47f3-a1b8-e87886b790ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040800 Jun 07 16:06:53.346747 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 458/937] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:06:53.708048 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:53.708868 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:53.710712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:53.711365 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:06:53.720908 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:53.721669 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:53.722588 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:53.723671 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:54.093199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:54.103232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8d746c99-b707-4c54-8095-a28ed249b3c1 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1314 microversion: 2.1 time: 0.399705 Jun 07 16:06:54.103823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 480/938] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:53 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:55.124624 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:55.125680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:55.136785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:55.137641 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:55.138438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:55.138881 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:55.744711 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:55.754635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-7f0f1547-aad7-4870-93ad-de423306705f tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1498 microversion: 2.1 time: 0.634172 Jun 07 16:06:55.754635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 459/939] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:55 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:56.301717 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:56.303034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:56.311415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:56.311871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:56.312875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:56.313482 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:56.341802 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:06:56.446785 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-21e8e5c3-7ff1-478c-bf67-9ad958a1f062 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 204 len: 0 microversion: 2.1 time: 0.148421 Jun 07 16:06:56.448500 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 481/940] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:06:56 2022] DELETE /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:06:56.456784 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:56.457359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:56.464279 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:56.464979 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:56.466394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:56.467567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:56.685312 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:56.693758 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-17eff9b4-12ed-4446-bba6-ead43c3567f0 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1504 microversion: 2.1 time: 0.240964 Jun 07 16:06:56.694688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 460/941] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:56 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:57.713461 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:57.714944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:57.721469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:57.723336 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:57.724198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:57.724687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:57.915353 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:57.929637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f0cae7b0-04ca-4906-9728-2167c5db34da tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1504 microversion: 2.1 time: 0.221736 Jun 07 16:06:57.930223 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 482/942] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:57 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:06:58.851665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-4351d43e-28d3-4669-b670-f3f73d6f34eb req-d5792a9c-269c-4737-ab7e-ddba2bf9e3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49779b06-5543-4125-8d9e-f0b9fa78015e", "name": "network-vif-deleted", "tag": "44620ff1-b162-4cc0-9379-ec079c59e72f"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:06:58.863869 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4351d43e-28d3-4669-b670-f3f73d6f34eb req-d5792a9c-269c-4737-ab7e-ddba2bf9e3b6 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:58.867690 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4351d43e-28d3-4669-b670-f3f73d6f34eb req-d5792a9c-269c-4737-ab7e-ddba2bf9e3b6 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:58.886775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-4351d43e-28d3-4669-b670-f3f73d6f34eb req-d5792a9c-269c-4737-ab7e-ddba2bf9e3b6 service nova] Creating event network-vif-deleted:44620ff1-b162-4cc0-9379-ec079c59e72f for instance 49779b06-5543-4125-8d9e-f0b9fa78015e on hv-cinder-84487 Jun 07 16:06:58.896913 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-4351d43e-28d3-4669-b670-f3f73d6f34eb req-d5792a9c-269c-4737-ab7e-ddba2bf9e3b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Jun 07 16:06:58.903078 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 461/943] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:06:58.947690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:06:58.949441 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:06:58.963725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:58.966027 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:58.970405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:58.971245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:59.018672 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:06:59.020440 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:06:59.021148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lazy-loading 'fault' on Instance uuid 49779b06-5543-4125-8d9e-f0b9fa78015e {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:06:59.080206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4244e60b4d424bf29575b8214aadde9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad305bb9275482b95b858fa3669e8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:06:59.089173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4b530a58-8416-457b-8adb-630d55c558f8 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 200 len: 1304 microversion: 2.1 time: 0.146278 Jun 07 16:06:59.090823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 483/944] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:06:58 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:00.109917 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:00.111513 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] [instance: 49779b06-5543-4125-8d9e-f0b9fa78015e] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:00.133363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:00.134030 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:00.134870 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:00.135515 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:00.152423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] HTTP exception thrown: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Request method failure captured: Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e HTTP/1.1 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3dvaaaEttaVaU-sfCcMLIuL4KS4lJQgxhWyJUXYAeXiiB5yuAHtsW9TcGUTJpMjJVuXnUw07CnLgFfIPt7V62GG9nucScGeQme0UeGFP1CtLVP2q5xB5z_V1fkZp6DJGAuIjLecRidLPKfJSQ6kyU8PU0dL22v-GdD-1xcQMNOndXA Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: aad305bb9275482b95b858fa3669e8e9 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesActionsTest-2092477073 Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:07:00.154127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad305bb9275482b95b858fa3669e8e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aad305bb9275482b95b858fa3669e8e9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesActionsTest-2092477073 Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: aad305bb9275482b95b858fa3669e8e9 Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesActionsTest-2092477073 Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesActionsTest-2092477073-project Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 4244e60b4d424bf29575b8214aadde9a Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesActionsTest-2092477073-project Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. Jun 07 16:07:00.155675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '49779b06-5543-4125-8d9e-f0b9fa78015e'} Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:07:00.156924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. Jun 07 16:07:00.158764 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:07:00.160521 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] Returning 404 to user: Instance 49779b06-5543-4125-8d9e-f0b9fa78015e could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:07:00.160521 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8b1ef3ea-3dd7-4881-808b-8d1d3e668ba2 tempest-VolumesActionsTest-2092477073 tempest-VolumesActionsTest-2092477073-project] 10.222.0.18 "GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e" status: 404 len: 111 microversion: 2.1 time: 0.052479 Jun 07 16:07:00.160521 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 462/945] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:00 2022] GET /compute/v2.1/servers/49779b06-5543-4125-8d9e-f0b9fa78015e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:07:14.949505 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'create', calling method: .version_select at 0x7f1448464af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-109819258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRVVjb5Sk7ETgeDlJm/n2pwykoFGvupVCXsogRErTxv7BCyE5jvImcTHEA92dngMksP9QnepkSNxuB67QDBbiFcTYZ/FNCqoxP8hyCGkrPEVrFzC04IthsqObJN2tHz0Q=="}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:14.955289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:14.955919 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:14.973274 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Getting quotas for project 0598199897de4461b994edd96e987dfb. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:07:14.980448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.quota [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Getting quotas for user bce573cefd1641559d57ba0b0d2a8b3c and project 0598199897de4461b994edd96e987dfb. Resources: {'key_pairs'} {{(pid=117818) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:07:14.997232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [af4fe8a2-fa1f-4783-9520-7243bf3676b8] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 16:07:16.007322 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [af4fe8a2-fa1f-4783-9520-7243bf3676b8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37000. Jun 07 16:07:16.023960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e1774684-b11f-4602-beb6-c8d5b2e09c92 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.078321 Jun 07 16:07:16.035152 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 484/946] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 7 16:07:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:16.139474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-126030242", "imageRef": "04a3127c-180c-4135-83e6-496661ee0a06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-109819258", "networks": [{"uuid": "7501c96e-4dd9-43da-bc90-8b90ac075e50"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:16.148025 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:16.148687 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=37 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:16.212274 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] validate_networks() for [('7501c96e-4dd9-43da-bc90-8b90ac075e50', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:07:16.872268 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:07:16.872726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:07:16.873214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:07:16.873844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:07:16.874257 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:07:16.892330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:16.895752 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:16.897036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:16.897675 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:16.922949 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Getting quotas for project 0598199897de4461b994edd96e987dfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:07:16.927410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Getting quotas for user bce573cefd1641559d57ba0b0d2a8b3c and project 0598199897de4461b994edd96e987dfb. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:07:16.939496 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:07:16.941954 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04a3127c-180c-4135-83e6-496661ee0a06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:07:16.996877 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-06e6e83e-d2b7-44cf-a82d-a87bff75206b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869127 Jun 07 16:07:16.998255 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 463/947] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 16:07:17.014871 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8e33d93c-bbfe-43ae-aad2-564efd120a23 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:17.017058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8e33d93c-bbfe-43ae-aad2-564efd120a23 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:17.106337 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8e33d93c-bbfe-43ae-aad2-564efd120a23 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:17.119469 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8e33d93c-bbfe-43ae-aad2-564efd120a23 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1257 microversion: 2.1 time: 0.112672 Jun 07 16:07:17.120326 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 485/948] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:17 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1257 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:18.138795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:18.139653 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:18.152506 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:18.152654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:18.153531 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:18.154049 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:18.222249 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:18.230408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f3190035-8742-4074-82b6-876a4e2f0050 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1309 microversion: 2.1 time: 0.096403 Jun 07 16:07:18.232904 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 464/949] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:18 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:19.249912 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:19.251400 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:19.264570 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:19.265388 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:19.266459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:19.267497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:19.528690 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:19.543401 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dd2bfcc5-3fba-4b95-a1e8-d22fe099f1be tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.295030 Jun 07 16:07:19.544037 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 486/950] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:19 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:20.563065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:20.564660 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:20.576123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:20.579775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:20.581689 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:20.583456 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:21.157015 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-144b1a1e-58cf-400e-901b-5e4c429dc253 req-d35ebbd9-27fc-4181-ae57-c758250a54fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:21.171548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-144b1a1e-58cf-400e-901b-5e4c429dc253 req-d35ebbd9-27fc-4181-ae57-c758250a54fc service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:21.172308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-144b1a1e-58cf-400e-901b-5e4c429dc253 req-d35ebbd9-27fc-4181-ae57-c758250a54fc service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:21.185895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-144b1a1e-58cf-400e-901b-5e4c429dc253 req-d35ebbd9-27fc-4181-ae57-c758250a54fc service nova] Creating event network-changed:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:07:21.192198 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-144b1a1e-58cf-400e-901b-5e4c429dc253 req-d35ebbd9-27fc-4181-ae57-c758250a54fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064886 Jun 07 16:07:21.193114 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 487/951] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:21.324403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:21.338389 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-4a664547-4e11-4848-aeb6-a27d10c34d26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.779016 Jun 07 16:07:21.350315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 465/952] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:20 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:22.365044 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:22.367386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:22.414246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:22.416185 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:22.418181 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:22.419408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:22.681951 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:22.702516 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e909fbef-87d7-4b7d-904b-d9448769f498 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.348912 Jun 07 16:07:22.703196 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 488/953] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:22 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:23.723214 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:23.723852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:23.730555 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:23.731004 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:23.731761 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:23.732458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:23.914997 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:23.922676 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6916426a-8725-4378-9f3f-799d08a4da26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.203440 Jun 07 16:07:23.923241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 466/954] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:23 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:24.943259 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:24.943853 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:24.975984 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:24.976654 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:24.977449 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:24.977896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:25.132199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:25.141548 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-65a2815c-425f-4fb3-8a5f-2ff35688c74e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.203288 Jun 07 16:07:25.142392 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 489/955] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:24 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:26.160707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:26.161388 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:26.168316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:26.168829 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:26.169684 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:26.170379 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:26.330156 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:26.342409 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-eb24a8d3-bdca-4327-b40b-c9f7ed162652 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.185958 Jun 07 16:07:26.344017 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 467/956] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:26 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:27.366659 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:27.367408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:27.369540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:27.377211 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:27.378051 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:27.379287 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:27.379892 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:27.567782 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:27.575726 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7593feba-f0b5-4c9e-94ec-89cfadce1aa7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.219858 Jun 07 16:07:27.576397 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 490/957] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:27 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:28.597524 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:28.598206 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:28.600105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:28.600793 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:28.607699 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:28.608155 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:28.608962 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:28.609398 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:28.760296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:28.780857 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e6fc8b49-50ab-4b72-b381-4e4bb746e64a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.187693 Jun 07 16:07:28.781443 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 468/958] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:28 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:29.799061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:29.800333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:29.806790 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:29.807232 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:29.807989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:29.808451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:29.941884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:29.949651 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b8147318-175f-4285-8b49-01f918939e87 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.154495 Jun 07 16:07:29.950215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 491/959] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:29 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:30.653098 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2006276918", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "networks": [{"uuid": "8af59b9d-86bd-4119-bcdf-4579e7e6448f"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:30.703875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] validate_networks() for [('8af59b9d-86bd-4119-bcdf-4579e7e6448f', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:07:30.965799 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:30.966416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:30.972829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:30.973280 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:30.974043 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:30.974481 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:31.078006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:07:31.078499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:07:31.079034 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:07:31.079512 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:07:31.079988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:07:31.089532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:31.090065 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:31.090945 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:31.091453 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:31.108123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Getting quotas for project ab43bc41a9b44512b7e3e4c1f721bacf. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:07:31.112425 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Getting quotas for user 8725c1db5ee3468d881a42a3f2df50ea and project ab43bc41a9b44512b7e3e4c1f721bacf. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:07:31.124489 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:07:31.125524 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:31.126616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:07:31.133745 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7572ee62-a7a4-4e2a-890b-f5abe83c5e22 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.171734 Jun 07 16:07:31.135008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 492/960] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:30 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:31.179545 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f06a4a3a-027d-4717-bd6c-4634a18441ad tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530274 Jun 07 16:07:31.180195 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 469/961] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:07:31.190752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b6c1363a-a636-44ec-88eb-553a39188230 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:31.191457 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b6c1363a-a636-44ec-88eb-553a39188230 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:31.243866 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b6c1363a-a636-44ec-88eb-553a39188230 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:31.251618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b6c1363a-a636-44ec-88eb-553a39188230 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1219 microversion: 2.1 time: 0.065465 Jun 07 16:07:31.252184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 493/962] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:31 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:32.154126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:32.154746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:32.161073 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:32.161527 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:32.162294 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:32.162760 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:32.269489 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:32.270222 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:32.276607 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:32.284940 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:32.285884 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:32.286362 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:32.369530 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:32.373912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:32.377149 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-77e1bd60-33bf-4f05-bec9-a5e16c6ed6f3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1277 microversion: 2.1 time: 0.111875 Jun 07 16:07:32.378391 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 494/963] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:32 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:32.381789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-ae29edcf-a0af-4e2e-b559-e8370a02b241 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.232342 Jun 07 16:07:32.382616 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 470/964] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:32 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:33.397455 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:33.398944 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:33.399083 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:33.399624 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:33.406634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:33.407322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:33.408308 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:33.409333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:33.410171 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:33.410323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:33.411311 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:33.411963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:33.711089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:33.719199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8e60a827-71a5-43c4-a854-a12ae4b50320 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.328089 Jun 07 16:07:33.732746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:33.733680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 495/965] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:33 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:33.734755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-26bd52a2-41d9-49dc-93de-3c238f296c39 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.339376 Jun 07 16:07:33.746818 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 471/966] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:33 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:33.747200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-fa231025-211c-471f-b309-2760606656f1 req-ac9ca5c7-8754-49c1-9d5f-f4c664d14797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fa7681-3113-4055-9fa4-997c1ac6b7a3", "tag": "6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:33.750763 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa231025-211c-471f-b309-2760606656f1 req-ac9ca5c7-8754-49c1-9d5f-f4c664d14797 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:33.751289 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-fa231025-211c-471f-b309-2760606656f1 req-ac9ca5c7-8754-49c1-9d5f-f4c664d14797 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:33.763813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-fa231025-211c-471f-b309-2760606656f1 req-ac9ca5c7-8754-49c1-9d5f-f4c664d14797 service nova] Creating event network-changed:6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96 for instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 on hv-cinder-84487 Jun 07 16:07:33.769251 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-fa231025-211c-471f-b309-2760606656f1 req-ac9ca5c7-8754-49c1-9d5f-f4c664d14797 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 Jun 07 16:07:33.769850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 496/967] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:34.740253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:34.740916 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:34.747337 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:34.747785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:34.748567 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:34.748999 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:34.755956 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:34.756694 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:34.762862 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:34.763310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:34.764074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:34.764549 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:34.941053 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:34.948482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-da5f936d-1143-43b3-a4fe-0b747c79a0ec tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.212218 Jun 07 16:07:34.949048 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 472/968] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:34 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:34.954272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:34.961895 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-926ec970-be8c-48d4-a02a-31f9cfdccbb4 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.211378 Jun 07 16:07:34.962453 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 497/969] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:34 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:35.337070 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-29079fff-2ec0-46f5-b4d3-d1f35c284169 req-9f06ccb5-775f-4cb2-a1cd-180a3ff4cb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "name": "network-vif-plugged", "status": "completed", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:35.345635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-29079fff-2ec0-46f5-b4d3-d1f35c284169 req-9f06ccb5-775f-4cb2-a1cd-180a3ff4cb5f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:35.346702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-29079fff-2ec0-46f5-b4d3-d1f35c284169 req-9f06ccb5-775f-4cb2-a1cd-180a3ff4cb5f service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:35.360081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-29079fff-2ec0-46f5-b4d3-d1f35c284169 req-9f06ccb5-775f-4cb2-a1cd-180a3ff4cb5f service nova] Creating event network-vif-plugged:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:07:35.365845 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-29079fff-2ec0-46f5-b4d3-d1f35c284169 req-9f06ccb5-775f-4cb2-a1cd-180a3ff4cb5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 Jun 07 16:07:35.366438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 473/970] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:35.965643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:35.966350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:35.974161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:35.974609 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:35.975368 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:35.975804 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:35.978560 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:35.979274 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:35.986533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:35.987199 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:35.988128 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:35.988591 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:36.188764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:36.192263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:36.197159 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-33f4fda2-e9b7-4347-8216-8bc442722ee3 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.235320 Jun 07 16:07:36.197918 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 498/971] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:35 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:36.199634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a1b20166-1477-4166-b8ef-f74573ad8f63 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.225224 Jun 07 16:07:36.200192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 474/972] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:35 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:37.215011 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:37.215622 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:37.217557 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:37.218185 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:37.223157 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:37.223611 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:37.224399 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:37.224834 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:37.226361 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:37.226817 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:37.227775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:37.228217 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:37.441624 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:37.443042 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:37.451136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dae9d635-7769-4b6a-94d2-af9b629720e8 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.240196 Jun 07 16:07:37.451833 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-562c9ac9-3eb8-4099-99a3-df64d107d52c tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1357 microversion: 2.1 time: 0.238896 Jun 07 16:07:37.461844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 475/973] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:37 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:37.462757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 499/974] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:37 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:38.468927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:38.469473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:38.469868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:38.469971 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:38.476451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.476603 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.476905 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.477026 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.477668 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.477790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.478109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.478220 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.668926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:38.671907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:38.677430 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-bf40712a-8dcc-479b-81a4-e29ad309f661 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.212544 Jun 07 16:07:38.678457 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 476/975] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:38 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:38.681522 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2b7e809f-9f90-4b1d-8e44-63005a8e45e1 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1546 microversion: 2.1 time: 0.216358 Jun 07 16:07:38.682390 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 500/976] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:38 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1546 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:38.697926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:38.698536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:38.704449 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.704898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.706200 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.706626 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.843296 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:38.851604 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2708cd6e-147a-47dd-b008-fc65ac44998f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1546 microversion: 2.1 time: 0.157582 Jun 07 16:07:38.852177 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 477/977] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:38 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:38.867075 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:38.870493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:38.871263 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Searching by: {'deleted': False, 'project_id': '0598199897de4461b994edd96e987dfb'} {{(pid=117818) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 16:07:38.878038 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.878487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.879284 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:38.879725 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:38.967990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.multi_cell_list [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 16:07:39.067562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9781a444-ca59-4678-893c-5ab6c23a2c1d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204049 Jun 07 16:07:39.068080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 501/978] 10.222.0.18 () {58 vars in 1124 bytes} [Tue Jun 7 16:07:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:39.078047 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:39.078650 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:39.085345 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:39.085789 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:39.086535 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:39.086968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:39.216329 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:39.223935 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e1411613-155d-4a5e-bb83-bc95bae259b0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1546 microversion: 2.1 time: 0.149615 Jun 07 16:07:39.224539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 478/979] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:39 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:39.378586 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-c6353edf-fb05-4843-b02b-c927733bc8ba req-7836c42b-68d6-42aa-8892-f1477c851475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fa7681-3113-4055-9fa4-997c1ac6b7a3", "name": "network-vif-plugged", "status": "completed", "tag": "6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:39.387376 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c6353edf-fb05-4843-b02b-c927733bc8ba req-7836c42b-68d6-42aa-8892-f1477c851475 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:39.388004 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-c6353edf-fb05-4843-b02b-c927733bc8ba req-7836c42b-68d6-42aa-8892-f1477c851475 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:39.402857 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-c6353edf-fb05-4843-b02b-c927733bc8ba req-7836c42b-68d6-42aa-8892-f1477c851475 service nova] Creating event network-vif-plugged:6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96 for instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 on hv-cinder-84487 Jun 07 16:07:39.410422 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-c6353edf-fb05-4843-b02b-c927733bc8ba req-7836c42b-68d6-42aa-8892-f1477c851475 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 Jun 07 16:07:39.411323 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 502/980] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:39.696875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:39.697487 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:39.703757 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:39.704197 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:39.704981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:39.706166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:39.838790 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:39.847726 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e8526e5a-89e6-4a4a-8eba-52bd0c9f858f tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.154652 Jun 07 16:07:39.848234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 479/981] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:39 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:40.785741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb719be1-160f-4011-86aa-9f4c23e8f21f"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:40.786916 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:40.793540 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:40.793988 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:40.794746 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:40.795187 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:40.864786 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:40.865442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:40.871814 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:40.872265 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:40.873068 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:40.873502 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:41.007012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:41.014469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6227a82e-2639-45a8-84de-653cfb8e2a36 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1319 microversion: 2.1 time: 0.154055 Jun 07 16:07:41.015029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 480/982] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:40 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:07:41.240089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:41.248883 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:41.250968 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-3c2af40b-7ac7-4bd3-b98a-3dc4105ff08d tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469590 Jun 07 16:07:41.251913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 503/983] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:07:40 2022] POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:42.031261 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:42.031841 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:42.033802 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:42.034452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:42.040779 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:42.041230 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:42.042024 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:42.042460 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:42.059982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=100 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:42.168877 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:42.176636 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c6a9f44c-3539-4477-bd2d-919829861fbe tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1509 microversion: 2.1 time: 0.149274 Jun 07 16:07:42.177202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 481/984] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:42 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:48.807945 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:48.808788 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:48.811325 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:48.818373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:48.818815 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:48.819583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:48.820019 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:48.911120 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:48.957887 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:48.966330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fcad2c66-913a-4557-ac54-9cdf385177a0 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1592 microversion: 2.1 time: 0.163696 Jun 07 16:07:48.966896 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 504/985] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:48 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1592 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:50.774322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-781d1730-9328-449d-9828-b29f8473e20d req-f1a4bacc-8ccb-4f1f-97c7-17d47a776896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:50.784038 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:07:50.788816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-781d1730-9328-449d-9828-b29f8473e20d req-f1a4bacc-8ccb-4f1f-97c7-17d47a776896 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:50.789562 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-781d1730-9328-449d-9828-b29f8473e20d req-f1a4bacc-8ccb-4f1f-97c7-17d47a776896 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:50.802375 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-781d1730-9328-449d-9828-b29f8473e20d req-f1a4bacc-8ccb-4f1f-97c7-17d47a776896 service nova] Creating event network-changed:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:07:50.807746 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-781d1730-9328-449d-9828-b29f8473e20d req-f1a4bacc-8ccb-4f1f-97c7-17d47a776896 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037976 Jun 07 16:07:50.808344 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 482/986] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:51.859752 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-744824152"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:51.860878 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:51.867914 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:51.868431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:51.869229 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:51.869856 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:52.005359 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.network.security_group_api [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Adding security group 96af920b-90d8-4ec6-bd97-9e1eedb81f8c to port bb394a22-3523-40cd-8341-5b364302539a Jun 07 16:07:52.391330 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-febc0b57-ec67-46e1-b0ac-3264fa4b6e50 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action" status: 202 len: 0 microversion: 2.1 time: 0.535703 Jun 07 16:07:52.393036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 505/987] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:07:51 2022] POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:07:52.410569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:52.411295 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:52.419066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:52.419532 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:52.420344 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:52.420765 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:52.595202 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:52.604761 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-750664a2-67d6-46c0-8b5b-64dff399b775 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1757 microversion: 2.1 time: 0.207247 Jun 07 16:07:52.616172 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 483/988] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:52 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:52.822148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-56b80c3d-7123-4330-a5c7-1d9ae518f892 req-ee9ca1c0-b758-4e3c-be06-4887029fa552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:52.830309 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-56b80c3d-7123-4330-a5c7-1d9ae518f892 req-ee9ca1c0-b758-4e3c-be06-4887029fa552 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:52.830823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-56b80c3d-7123-4330-a5c7-1d9ae518f892 req-ee9ca1c0-b758-4e3c-be06-4887029fa552 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:52.842676 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-56b80c3d-7123-4330-a5c7-1d9ae518f892 req-ee9ca1c0-b758-4e3c-be06-4887029fa552 service nova] Creating event network-changed:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:07:52.847783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-56b80c3d-7123-4330-a5c7-1d9ae518f892 req-ee9ca1c0-b758-4e3c-be06-4887029fa552 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029900 Jun 07 16:07:52.848679 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 506/989] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:57.326930 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e71607-4322-4192-a27b-120c5cfc5705", "device": "/dev/sdb"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:57.328588 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:57.335873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.336444 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.337394 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.337831 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.565418 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:57.566089 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:57.573941 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.574396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.575172 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.575613 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.604543 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:07:57.613887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f609da1b-df09-40f4-9a39-bdb5ea278d3a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "POST /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290691 Jun 07 16:07:57.619468 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 484/990] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:07:57 2022] POST /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:57.622189 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-7a1f55b4-eb42-4f8c-acc4-77ece19cd5a0 req-bdc6a323-0554-4f48-8b8c-62ba0e4cb34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ada36d-b4a9-4183-b872-8810804ff83d", "tag": "764822f5-eb58-4c69-86cf-5133a4e4dddf"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:07:57.630426 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-7a1f55b4-eb42-4f8c-acc4-77ece19cd5a0 req-bdc6a323-0554-4f48-8b8c-62ba0e4cb34c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.630876 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-7a1f55b4-eb42-4f8c-acc4-77ece19cd5a0 req-bdc6a323-0554-4f48-8b8c-62ba0e4cb34c service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.648823 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-7a1f55b4-eb42-4f8c-acc4-77ece19cd5a0 req-bdc6a323-0554-4f48-8b8c-62ba0e4cb34c service nova] Creating event network-changed:764822f5-eb58-4c69-86cf-5133a4e4dddf for instance e8ada36d-b4a9-4183-b872-8810804ff83d on hv-cinder-84487 Jun 07 16:07:57.657442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-7a1f55b4-eb42-4f8c-acc4-77ece19cd5a0 req-bdc6a323-0554-4f48-8b8c-62ba0e4cb34c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041227 Jun 07 16:07:57.658568 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 485/991] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:07:57.737642 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-18283d23-7a09-47df-83a2-880c45af36b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 204 len: 0 microversion: 2.1 time: 0.177774 Jun 07 16:07:57.755451 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 507/992] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:07:57 2022] DELETE /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:07:57.760408 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:57.761439 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:57.772320 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.773471 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.774253 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:57.774696 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:57.912576 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:57.921263 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-213f59d0-5835-4d65-b955-255b73f6e06e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1578 microversion: 2.1 time: 0.166949 Jun 07 16:07:57.921837 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 486/993] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:57 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:07:58.939554 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:07:58.940151 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:07:58.947653 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:58.948092 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:58.948867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:07:58.949299 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:07:59.378851 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:07:59.387931 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9f86833d-75e9-432f-91d1-a55fba7b874d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1578 microversion: 2.1 time: 0.452618 Jun 07 16:07:59.388905 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 508/994] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:07:58 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1578 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:00.243873 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-4c21f571-ef1c-4f56-bf25-34d3d1c9b493 req-f93aecd2-2b8c-4f16-bd74-56c6fd053cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ada36d-b4a9-4183-b872-8810804ff83d", "name": "network-vif-deleted", "tag": "764822f5-eb58-4c69-86cf-5133a4e4dddf"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:00.253161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4c21f571-ef1c-4f56-bf25-34d3d1c9b493 req-f93aecd2-2b8c-4f16-bd74-56c6fd053cc9 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:00.253672 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-4c21f571-ef1c-4f56-bf25-34d3d1c9b493 req-f93aecd2-2b8c-4f16-bd74-56c6fd053cc9 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:00.265785 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-4c21f571-ef1c-4f56-bf25-34d3d1c9b493 req-f93aecd2-2b8c-4f16-bd74-56c6fd053cc9 service nova] Creating event network-vif-deleted:764822f5-eb58-4c69-86cf-5133a4e4dddf for instance e8ada36d-b4a9-4183-b872-8810804ff83d on hv-cinder-84487 Jun 07 16:08:00.270828 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-4c21f571-ef1c-4f56-bf25-34d3d1c9b493 req-f93aecd2-2b8c-4f16-bd74-56c6fd053cc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Jun 07 16:08:00.274926 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 487/995] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:00.405643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:00.406227 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:00.412707 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:00.413153 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:00.414245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:00.414680 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:00.475228 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:00.483850 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-38650fb6-0500-4c5e-a2eb-25cec5b44503 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 200 len: 1225 microversion: 2.1 time: 0.082094 Jun 07 16:08:00.484448 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 509/996] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:00 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:01.501635 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:01.502333 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: e8ada36d-b4a9-4183-b872-8810804ff83d] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:01.508919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:01.509186 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:01.509939 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:01.510370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:01.523863 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] HTTP exception thrown: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Request method failure captured: Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d HTTP/1.1 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3X65oQzWBMq0IUmRH2B_w38zFJJobzA4cOf7bSuOw3QkfBMkdBvSO4kxElOqtVLVMqGJidMiLSfFjjjn0YnbaBhdzKOUbAoS2jduXmThMJdaj3hxguC78ogdJxf3Eh1qCl8SACN_FN3y3RQLNrDrAXFgbz8sYFmDeTOCSJaJLp3PU8 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:08:01.525499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44a1ab295b3a423aa2b3183a3e25ec0b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: c26cd29ec472479a9a36ac9bb1f05580 Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. Jun 07 16:08:01.527215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'e8ada36d-b4a9-4183-b872-8810804ff83d'} Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:08:01.528256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. Jun 07 16:08:01.529875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:01.531322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Returning 404 to user: Instance e8ada36d-b4a9-4183-b872-8810804ff83d could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:08:01.531322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f745669c-9c43-4531-b3cd-3c8b1bff7feb tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d" status: 404 len: 111 microversion: 2.1 time: 0.029865 Jun 07 16:08:01.531322 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 488/997] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:01 2022] GET /compute/v2.1/servers/e8ada36d-b4a9-4183-b872-8810804ff83d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:08:04.744512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:04.745053 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:04.751562 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:04.752018 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:04.752843 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:04.753286 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:04.754630 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-2f7dabb8-d3b2-429f-87c5-aa92868e8c91 req-1d430deb-02a2-4e38-8df9-c9a5c4fae6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300403ca-f879-42eb-942e-b71ccfd7d4f9", "tag": "e8077d1d-3d8c-4470-a85e-ad23d31f79df"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:04.764674 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2f7dabb8-d3b2-429f-87c5-aa92868e8c91 req-1d430deb-02a2-4e38-8df9-c9a5c4fae6ca service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:04.765259 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-2f7dabb8-d3b2-429f-87c5-aa92868e8c91 req-1d430deb-02a2-4e38-8df9-c9a5c4fae6ca service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:04.777958 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-2f7dabb8-d3b2-429f-87c5-aa92868e8c91 req-1d430deb-02a2-4e38-8df9-c9a5c4fae6ca service nova] Creating event network-changed:e8077d1d-3d8c-4470-a85e-ad23d31f79df for instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 on hv-cinder-84487 Jun 07 16:08:04.782944 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-2f7dabb8-d3b2-429f-87c5-aa92868e8c91 req-1d430deb-02a2-4e38-8df9-c9a5c4fae6ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039981 Jun 07 16:08:04.784256 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 489/998] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:04.788115 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Going to try to terminate instance {{(pid=117818) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:08:04.867008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-e736215e-38b1-4709-81c2-1d61918dc2f9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 204 len: 0 microversion: 2.1 time: 0.126507 Jun 07 16:08:04.867604 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 510/999] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:08:04 2022] DELETE /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:08:04.876234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:04.876961 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:04.883709 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:04.884152 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:04.884970 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:04.885402 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:05.029051 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:05.036963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-22a0cf17-3813-4270-9a44-8d387ed5beb9 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1576 microversion: 2.1 time: 0.164887 Jun 07 16:08:05.042994 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 490/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:04 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:06.055048 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:06.055741 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:06.062137 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:06.062583 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:06.063333 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:06.063764 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:06.233008 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:06.240496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-6000b827-8c7b-4af5-be9a-8ffb94bb3b4b tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1576 microversion: 2.1 time: 0.189826 Jun 07 16:08:06.241058 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 511/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:06 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:07.258201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:07.258836 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:07.265599 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:07.266126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:07.267036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:07.267547 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:07.537484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:07.545854 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6971c173-bb61-4075-b490-676b36a54378 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1576 microversion: 2.1 time: 0.292343 Jun 07 16:08:07.546440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 491/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:07 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:07.693981 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-f9e18fa9-c921-4884-9afa-0b1f402aac94 req-c571bf17-3ef3-43e7-bc00-4f548e4bda20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300403ca-f879-42eb-942e-b71ccfd7d4f9", "name": "network-vif-deleted", "tag": "e8077d1d-3d8c-4470-a85e-ad23d31f79df"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:07.703278 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-f9e18fa9-c921-4884-9afa-0b1f402aac94 req-c571bf17-3ef3-43e7-bc00-4f548e4bda20 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:07.703716 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-f9e18fa9-c921-4884-9afa-0b1f402aac94 req-c571bf17-3ef3-43e7-bc00-4f548e4bda20 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:07.717998 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-f9e18fa9-c921-4884-9afa-0b1f402aac94 req-c571bf17-3ef3-43e7-bc00-4f548e4bda20 service nova] Creating event network-vif-deleted:e8077d1d-3d8c-4470-a85e-ad23d31f79df for instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 on hv-cinder-84487 Jun 07 16:08:07.722683 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-f9e18fa9-c921-4884-9afa-0b1f402aac94 req-c571bf17-3ef3-43e7-bc00-4f548e4bda20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032325 Jun 07 16:08:07.723285 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 512/1003] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:08.564373 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:08.564988 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:08.572519 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:08.572952 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:08.573697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:08.574126 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:08.637417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:08.644898 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2d76d6e0-5cf1-4086-9fc1-70968295b5b1 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1225 microversion: 2.1 time: 0.084614 Jun 07 16:08:08.645458 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 492/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:08 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:09.662494 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:09.663774 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:09.670161 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:09.670605 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:09.671356 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:09.671784 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:09.734377 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:09.742462 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cfd6dd69-0efe-4758-ac39-5eff01d9d3c6 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1225 microversion: 2.1 time: 0.084493 Jun 07 16:08:09.743020 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 513/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:09 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:08:10.760579 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:10.761258 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:10.767912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:10.768378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:10.769187 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:10.769618 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:10.801546 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:10.801983 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:10.802435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.objects.instance [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lazy-loading 'fault' on Instance uuid 300403ca-f879-42eb-942e-b71ccfd7d4f9 {{(pid=117819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:08:10.845594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26cd29ec472479a9a36ac9bb1f05580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ab295b3a423aa2b3183a3e25ec0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:10.853803 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-6c5d7faf-736b-46df-94e7-2abb7adb156e tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 200 len: 1230 microversion: 2.1 time: 0.098301 Jun 07 16:08:10.854366 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 493/1006] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:10 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:11.871812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:11.872493 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 300403ca-f879-42eb-942e-b71ccfd7d4f9] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:11.879026 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:11.879477 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:11.880240 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:11.880710 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:11.894431 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] HTTP exception thrown: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Request method failure captured: Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 HTTP/1.1 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3X65oQzWBMq0IUmRH2B_w38zFJJobzA4cOf7bSuOw3QkfBMkdBvSO4kxElOqtVLVMqGJidMiLSfFjjjn0YnbaBhdzKOUbAoS2jduXmThMJdaj3hxguC78ogdJxf3Eh1qCl8SACN_FN3y3RQLNrDrAXFgbz8sYFmDeTOCSJaJLp3PU8 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:08:11.896077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44a1ab295b3a423aa2b3183a3e25ec0b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: c26cd29ec472479a9a36ac9bb1f05580 Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. Jun 07 16:08:11.897767 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '300403ca-f879-42eb-942e-b71ccfd7d4f9'} Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:08:11.899035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. Jun 07 16:08:11.900602 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:11.902035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Returning 404 to user: Instance 300403ca-f879-42eb-942e-b71ccfd7d4f9 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:08:11.902035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-58eeeb1a-0454-464a-a292-84116dfad516 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9" status: 404 len: 111 microversion: 2.1 time: 0.030312 Jun 07 16:08:11.902035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 514/1007] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:11 2022] GET /compute/v2.1/servers/300403ca-f879-42eb-942e-b71ccfd7d4f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:08:12.328189 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:12.328769 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:12.335127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:12.335572 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:12.336445 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:12.336887 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:12.339499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:12.353161 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] HTTP exception thrown: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Request method failure captured: Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: DELETE /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 HTTP/1.1 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3X65oQzWBMq0IUmRH2B_w38zFJJobzA4cOf7bSuOw3QkfBMkdBvSO4kxElOqtVLVMqGJidMiLSfFjjjn0YnbaBhdzKOUbAoS2jduXmThMJdaj3hxguC78ogdJxf3Eh1qCl8SACN_FN3y3RQLNrDrAXFgbz8sYFmDeTOCSJaJLp3PU8 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:08:12.354912 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44a1ab295b3a423aa2b3183a3e25ec0b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: c26cd29ec472479a9a36ac9bb1f05580 Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.356582 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': '37e23c26-7004-42f2-a16b-0bc65e4db372'} Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:08:12.357714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.358973 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.360241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Returning 404 to user: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:08:12.360241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-47a76c72-469f-464d-9270-1abc44fc4c8c tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 404 len: 111 microversion: 2.1 time: 0.031971 Jun 07 16:08:12.360241 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 494/1008] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:08:12 2022] DELETE /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:08:12.365308 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:12.365923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [instance: 37e23c26-7004-42f2-a16b-0bc65e4db372] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:12.373110 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:12.373561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:12.374350 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:12.374783 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:12.388550 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] HTTP exception thrown: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Request method failure captured: Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 HTTP/1.1 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3X65oQzWBMq0IUmRH2B_w38zFJJobzA4cOf7bSuOw3QkfBMkdBvSO4kxElOqtVLVMqGJidMiLSfFjjjn0YnbaBhdzKOUbAoS2jduXmThMJdaj3hxguC78ogdJxf3Eh1qCl8SACN_FN3y3RQLNrDrAXFgbz8sYFmDeTOCSJaJLp3PU8 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:08:12.390074 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44a1ab295b3a423aa2b3183a3e25ec0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44a1ab295b3a423aa2b3183a3e25ec0b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 44a1ab295b3a423aa2b3183a3e25ec0b Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestVolumeBootPattern-646513065 Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: c26cd29ec472479a9a36ac9bb1f05580 Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestVolumeBootPattern-646513065-project Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.392340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '37e23c26-7004-42f2-a16b-0bc65e4db372'} Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:08:12.393561 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. Jun 07 16:08:12.395070 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:08:12.397340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Returning 404 to user: Instance 37e23c26-7004-42f2-a16b-0bc65e4db372 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:08:12.397340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-31171dea-f950-46ed-b6e6-4932b1657bb7 tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372" status: 404 len: 111 microversion: 2.1 time: 0.029922 Jun 07 16:08:12.397340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 515/1009] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:12 2022] GET /compute/v2.1/servers/37e23c26-7004-42f2-a16b-0bc65e4db372 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 16:08:15.776151 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b88af4ba-3e09-463b-b357-d28d37c20b9d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] Calling method '.version_select at 0x7f1448881430>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:15.779383 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b88af4ba-3e09-463b-b357-d28d37c20b9d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [07a6aa94-5c9b-4186-a3b1-80505fbc2481] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 16:08:16.786476 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO oslo.messaging._drivers.impl_rabbit [None req-b88af4ba-3e09-463b-b357-d28d37c20b9d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] [07a6aa94-5c9b-4186-a3b1-80505fbc2481] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 37592. Jun 07 16:08:16.804201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b88af4ba-3e09-463b-b357-d28d37c20b9d tempest-TestVolumeBootPattern-646513065 tempest-TestVolumeBootPattern-646513065-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1550618767" status: 202 len: 0 microversion: 2.1 time: 1.032048 Jun 07 16:08:16.804816 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 495/1010] 10.222.0.18 () {58 vars in 1262 bytes} [Tue Jun 7 16:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1550618767 => generated 0 bytes in 1033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:08:23.462226 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:23.462793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:23.465412 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:23.466087 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:23.472040 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:23.472589 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:23.473360 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:23.473798 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:23.568526 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lazy-loading 'services' on Instance uuid b6fa7681-3113-4055-9fa4-997c1ac6b7a3 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:08:23.662858 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-acbab0d7-c348-4945-a6a4-24cd228b993c tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3/os-volume_attachments/d3e71607-4322-4192-a27b-120c5cfc5705" status: 202 len: 0 microversion: 2.1 time: 0.204987 Jun 07 16:08:23.663446 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 516/1011] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:08:23 2022] DELETE /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3/os-volume_attachments/d3e71607-4322-4192-a27b-120c5cfc5705 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:08:24.787007 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:24.787509 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:24.791073 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:24.796387 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:24.796840 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:24.797594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:24.798029 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:24.822864 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:08:24.897700 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-b114bfcf-1b38-4f3d-8a4c-709d9f341475 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 204 len: 0 microversion: 2.1 time: 0.114791 Jun 07 16:08:24.898810 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 496/1012] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:08:24 2022] DELETE /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:08:24.908340 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:24.909063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:24.916032 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:24.916506 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:24.917265 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:24.917703 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:25.051206 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:25.058974 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-04a9a5cf-150a-49c2-bfc0-52b57ae0e95a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1515 microversion: 2.1 time: 0.155434 Jun 07 16:08:25.059539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 517/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:24 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:26.076956 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:26.077654 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:26.084649 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:26.085092 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:26.085844 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:26.086275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:26.219275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:26.226688 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-566f99ad-2a4b-4d09-b98a-76fc3251f997 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1515 microversion: 2.1 time: 0.154096 Jun 07 16:08:26.227244 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 497/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:26 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:27.245447 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:27.246066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:27.252416 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:27.252872 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:27.253643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:27.254088 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:27.266708 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-fae0e51b-e579-487b-92d2-f2c198aad741 req-08055681-9bfa-453b-a48d-4685db081390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fa7681-3113-4055-9fa4-997c1ac6b7a3", "name": "network-vif-deleted", "tag": "6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:27.276791 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-fae0e51b-e579-487b-92d2-f2c198aad741 req-08055681-9bfa-453b-a48d-4685db081390 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:27.277451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-fae0e51b-e579-487b-92d2-f2c198aad741 req-08055681-9bfa-453b-a48d-4685db081390 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:27.289099 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-fae0e51b-e579-487b-92d2-f2c198aad741 req-08055681-9bfa-453b-a48d-4685db081390 service nova] Creating event network-vif-deleted:6ab40ed7-0387-4de4-ae03-a2bc3a5d9b96 for instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 on hv-cinder-84487 Jun 07 16:08:27.294550 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-fae0e51b-e579-487b-92d2-f2c198aad741 req-08055681-9bfa-453b-a48d-4685db081390 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Jun 07 16:08:27.295243 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 498/1015] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:27.327823 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:27.335491 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-cc851b9b-776a-4268-8dc5-bde49febade2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 200 len: 1473 microversion: 2.1 time: 0.094742 Jun 07 16:08:27.336071 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 518/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:27 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 1473 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:28.353892 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:28.354588 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: b6fa7681-3113-4055-9fa4-997c1ac6b7a3] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:28.361012 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:28.361459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:28.362215 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:28.362655 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:28.375617 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] HTTP exception thrown: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Request method failure captured: Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 HTTP/1.1 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3fB0TbTK0U5OJQ9y-gMLeFf6ajjTpGrny10Q2Abk1Ad4ZvLNGaC2U_a6mzTMVmRDhDnfLcKQ2Sy4E6eSd0u9td0sDOD6THcSEAyOujR2BJG7qnhdPbeQIvQcI4eSSvsMYuDWptm1KPBt7VTxiU3lKAnfflXK_RQuLPaDMBj96HlZt4 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: ab43bc41a9b44512b7e3e4c1f721bacf Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:08:28.377236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab43bc41a9b44512b7e3e4c1f721bacf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: ab43bc41a9b44512b7e3e4c1f721bacf Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotTestJSON-1473457464-project Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 8725c1db5ee3468d881a42a3f2df50ea Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotTestJSON-1473457464-project Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. Jun 07 16:08:28.378897 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'b6fa7681-3113-4055-9fa4-997c1ac6b7a3'} Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:08:28.379982 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. Jun 07 16:08:28.381539 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:08:28.382810 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Returning 404 to user: Instance b6fa7681-3113-4055-9fa4-997c1ac6b7a3 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:08:28.382810 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-e4bb1184-6434-42e5-9b2c-cee8e37b14e2 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3" status: 404 len: 111 microversion: 2.1 time: 0.030136 Jun 07 16:08:28.382810 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 499/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:28 2022] GET /compute/v2.1/servers/b6fa7681-3113-4055-9fa4-997c1ac6b7a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:08:32.201809 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:32.202813 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:32.209236 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:32.209643 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:32.210389 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:32.210849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:32.280816 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-995629e3-3763-47c9-a853-2ddd7145af26 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action" status: 202 len: 0 microversion: 2.1 time: 0.083374 Jun 07 16:08:32.281432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 519/1018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:08:32 2022] POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:08:32.289442 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:32.290083 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:32.297057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:32.297511 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:32.298271 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:32.298705 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:32.540081 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:32.548602 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-47ff1d90-df76-4bf6-8ee1-55f8676bedac tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1749 microversion: 2.1 time: 0.262996 Jun 07 16:08:32.549169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 500/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:32 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1749 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:33.567712 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:33.568438 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:33.575544 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:33.575990 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:33.576769 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:33.577212 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:33.718470 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:33.726435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-1d3e4fc4-8319-434e-ab68-f1ac6fee8db9 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.163608 Jun 07 16:08:33.727010 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 520/1020] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:33 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:34.743838 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:34.744474 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:34.751031 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:34.751481 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:34.752234 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:34.752697 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:34.897580 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:34.906250 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9248754f-378a-4651-9906-86ec0d2b1d49 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.166282 Jun 07 16:08:34.906821 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 501/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:34 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:35.924620 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:35.925239 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:35.931687 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:35.932210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:35.933006 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:35.933443 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:36.078342 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:36.086360 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-28f47cd4-8a94-43f7-bfcb-3cfed17778e7 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.165671 Jun 07 16:08:36.086917 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 521/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:35 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:36.201270 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1487594567", "imageRef": "a4da9d66-f2b4-4f1a-9834-5dc46aca98ac", "flavorRef": "452", "networks": [{"uuid": "8af59b9d-86bd-4119-bcdf-4579e7e6448f"}]}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:36.253378 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.network.neutron [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] validate_networks() for [('8af59b9d-86bd-4119-bcdf-4579e7e6448f', None, None, None, None, None)] {{(pid=117819) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 16:08:36.591524 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Flavor limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 16:08:36.591938 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Image limits 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 16:08:36.592447 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Flavor pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 16:08:36.592852 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Image pref 0:0:0 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 16:08:36.593254 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.virt.hardware [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 16:08:36.601974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:36.602414 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:36.603192 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:36.603621 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:36.620718 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Getting quotas for project ab43bc41a9b44512b7e3e4c1f721bacf. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 16:08:36.624812 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.quota [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Getting quotas for user 8725c1db5ee3468d881a42a3f2df50ea and project ab43bc41a9b44512b7e3e4c1f721bacf. Resources: {'instances', 'ram', 'cores'} {{(pid=117819) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 16:08:36.636210 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Going to run 1 instances... {{(pid=117819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 16:08:36.638533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4da9d66-f2b4-4f1a-9834-5dc46aca98ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 16:08:36.683123 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-00c140a3-c741-4484-a977-c5c7dcd3323a tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486710 Jun 07 16:08:36.683721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 502/1023] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 7 16:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 16:08:36.693610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-86314835-596f-4f69-99fe-c63106df8a72 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:36.694310 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-86314835-596f-4f69-99fe-c63106df8a72 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:36.749200 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-86314835-596f-4f69-99fe-c63106df8a72 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:36.755879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-86314835-596f-4f69-99fe-c63106df8a72 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1219 microversion: 2.1 time: 0.066173 Jun 07 16:08:36.756467 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 522/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:36 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:08:37.103107 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:37.104236 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:37.110763 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:37.111211 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:37.112003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:37.112463 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:37.265057 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:37.273160 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a56d804a-acd6-4a29-b3a8-34a4b227a88e tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.173919 Jun 07 16:08:37.273668 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 503/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:37 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:37.776474 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:37.778136 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:37.785066 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:37.785512 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:37.787175 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:37.787622 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:37.878753 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:37.887082 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-65a7ff37-db59-4dc4-bd3c-1832ec8f3158 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1277 microversion: 2.1 time: 0.117475 Jun 07 16:08:37.887899 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 523/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:37 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:38.289953 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:38.290600 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:38.298036 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:38.298594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:38.299437 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:38.299946 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:38.526182 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:38.534222 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-96f0a74c-e44b-492f-b61c-a3fdcef2a883 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.248240 Jun 07 16:08:38.534792 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 504/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:38 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:38.904507 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:38.905130 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:38.911584 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:38.912036 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:38.912833 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:38.913272 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:39.098373 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:39.105811 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8e108023-cffc-433c-ad2e-c433e74acd62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.205654 Jun 07 16:08:39.106381 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 524/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:38 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:39.206090 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-5bb3e56e-f1f3-4658-9242-5cc1b9da1154 req-2ccde682-c210-4e0b-ac4d-2e196051f2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e500b3-762c-4156-aa55-3ca4020cc797", "tag": "d02120f0-8cec-44c2-bf07-7b48d8f0a577"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:39.215132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-5bb3e56e-f1f3-4658-9242-5cc1b9da1154 req-2ccde682-c210-4e0b-ac4d-2e196051f2c0 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:39.215619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-5bb3e56e-f1f3-4658-9242-5cc1b9da1154 req-2ccde682-c210-4e0b-ac4d-2e196051f2c0 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:39.233459 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-5bb3e56e-f1f3-4658-9242-5cc1b9da1154 req-2ccde682-c210-4e0b-ac4d-2e196051f2c0 service nova] Creating event network-changed:d02120f0-8cec-44c2-bf07-7b48d8f0a577 for instance a7e500b3-762c-4156-aa55-3ca4020cc797 on hv-cinder-84487 Jun 07 16:08:39.238452 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-5bb3e56e-f1f3-4658-9242-5cc1b9da1154 req-2ccde682-c210-4e0b-ac4d-2e196051f2c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 Jun 07 16:08:39.238892 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 505/1029] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:08:39.551083 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:39.551696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:39.558271 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:39.558715 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:39.559473 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:39.559989 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:39.699021 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:39.714354 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fe024a9a-4bda-421b-b4a8-b105fada4327 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.166134 Jun 07 16:08:39.715108 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 525/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:39 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:40.123704 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:40.124424 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:40.130662 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:40.131110 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:40.131870 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:40.132306 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:40.262619 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:40.269974 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-21e4d15a-6d88-41da-8811-9736e42adad5 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.151000 Jun 07 16:08:40.270534 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 506/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:40 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:40.734792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:40.735513 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:40.741907 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:40.742354 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:40.743167 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:40.743604 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:40.966336 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:40.974195 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b02703ab-1c96-40f3-9c8c-56de7434af3a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.243488 Jun 07 16:08:40.974760 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 526/1032] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:40 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:41.287006 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:41.287622 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:41.294753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:41.295201 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:41.295963 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:41.296489 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:41.426487 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:41.434494 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-45ef109a-c70f-4a20-b2f8-f63647a2d1aa tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.151330 Jun 07 16:08:41.435066 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 507/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:41 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:41.991992 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:41.992618 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:41.999648 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:42.000096 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:42.000960 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:42.001396 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:42.151709 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:42.159734 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-359f51af-aeed-4b86-a2ce-a1fa2f43bbfe tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.171583 Jun 07 16:08:42.160306 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 527/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:41 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:42.451132 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:42.451753 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:42.458328 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:42.458807 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:42.459554 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:42.460136 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:42.586203 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:42.594133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-018c5068-9b3d-4cb9-9fd1-ea693c8e5d62 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.146944 Jun 07 16:08:42.594703 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 508/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:42 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:43.177046 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:43.177661 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:43.184210 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:43.184691 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:43.185450 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:43.185888 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:43.329487 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:43.337454 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-c41bc787-ade8-44dc-83d7-4bf4f49bff15 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.164236 Jun 07 16:08:43.338035 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 528/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:43 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:43.570991 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-a63363c3-4aef-4e78-bfd7-d3e7210c654f req-320a43c2-9595-468c-bbcf-e6469132e5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e500b3-762c-4156-aa55-3ca4020cc797", "name": "network-vif-plugged", "status": "completed", "tag": "d02120f0-8cec-44c2-bf07-7b48d8f0a577"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:43.581237 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-a63363c3-4aef-4e78-bfd7-d3e7210c654f req-320a43c2-9595-468c-bbcf-e6469132e5fc service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:43.581786 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-a63363c3-4aef-4e78-bfd7-d3e7210c654f req-320a43c2-9595-468c-bbcf-e6469132e5fc service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:43.596002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-a63363c3-4aef-4e78-bfd7-d3e7210c654f req-320a43c2-9595-468c-bbcf-e6469132e5fc service nova] Creating event network-vif-plugged:d02120f0-8cec-44c2-bf07-7b48d8f0a577 for instance a7e500b3-762c-4156-aa55-3ca4020cc797 on hv-cinder-84487 Jun 07 16:08:43.601016 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-a63363c3-4aef-4e78-bfd7-d3e7210c654f req-320a43c2-9595-468c-bbcf-e6469132e5fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Jun 07 16:08:43.601606 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 509/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:43.611023 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:43.611633 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:43.617736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:43.618184 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:43.618939 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:43.620116 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:43.787757 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:43.795985 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7e255212-39dd-4b5d-8a4f-afe40de3581d tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.189062 Jun 07 16:08:43.796591 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 529/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:43 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:44.355762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:44.356469 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:44.363046 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:44.363484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:44.364493 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:44.364927 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:44.664968 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:44.673435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-05902885-cb3a-4aa7-8938-e711a3e2e31f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.322607 Jun 07 16:08:44.674011 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 510/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:44 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:44.813923 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:44.814471 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:44.821168 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:44.821624 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:44.823077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:44.823518 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:44.958556 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:44.965963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-59ae8009-d5f5-4314-adc6-6ba699cf1c28 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1319 microversion: 2.1 time: 0.156478 Jun 07 16:08:44.966527 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 530/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:44 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:45.692822 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:45.693438 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:45.701925 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:45.702712 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:45.703488 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:45.703937 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:45.851478 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:45.854569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:45.862645 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-78a22b55-7d92-44f9-944e-63d3e1aaac8b tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.173712 Jun 07 16:08:45.863229 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 511/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:45 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:45.982847 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:45.983459 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:45.990077 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:45.990520 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:45.991264 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:45.991695 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:46.120207 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:46.123693 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:46.128736 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8e54a36d-5661-4f38-a65a-53494b14e985 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1508 microversion: 2.1 time: 0.150059 Jun 07 16:08:46.129314 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 531/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:45 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:46.146288 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0c78cc-7449-4d07-af1d-66785f9b24ef", "device": "/dev/sdb"}} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:08:46.147374 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:46.155384 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:46.155868 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:46.156830 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:46.157260 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:46.394869 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cf2e4833-2178-4c50-a8f9-4017ca52d046 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "POST /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252306 Jun 07 16:08:46.395491 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 512/1043] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 7 16:08:46 2022] POST /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:08:46.879194 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:46.879867 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:46.882269 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell0:SELECT=2 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:46.889277 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:46.889727 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:46.890499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:46.890935 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:47.084967 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:47.093621 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-fab4903a-09d6-411d-b28b-06fe1623ff90 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.218516 Jun 07 16:08:47.094183 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 532/1044] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:46 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:48.108482 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=2 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:48.109139 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell0:SELECT=6 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:48.113191 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:48.113890 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:48.121543 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:48.121979 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:48.122724 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:48.123148 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:48.262390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:48.270416 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-170179e3-c50c-45bc-936e-dfb526e0d673 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.163711 Jun 07 16:08:48.270975 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 513/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:48 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:49.287652 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:49.288199 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:49.294865 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:49.295316 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:49.296079 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:49.296554 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:49.448935 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:49.456849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-4f8c570b-6fb0-40b8-8bfe-d75e1a547898 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.173212 Jun 07 16:08:49.457424 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 533/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:49 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:50.474095 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:50.474647 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:50.482146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:50.482861 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:50.483702 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:50.484227 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:50.630165 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:50.638875 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-cacae052-3d77-4514-9bb3-cc7ac08ee1f6 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.168844 Jun 07 16:08:50.639634 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 514/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:50 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:51.656435 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:51.657056 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:51.664007 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:51.664555 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:51.665319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:51.665846 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:51.809525 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:51.817479 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-63b30a34-965c-44cd-a7e1-65c3bd03bfee tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.165035 Jun 07 16:08:51.818046 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 534/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:51 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:52.835412 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:52.836251 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:52.844468 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:52.845298 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:52.846680 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:52.847278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:53.005350 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:53.013795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-2968f20e-9381-4791-86af-ce7f74eb7afd tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.182259 Jun 07 16:08:53.014363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 515/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:52 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:54.031148 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:54.031797 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:54.034315 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=41 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:54.039950 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:54.040432 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:54.041948 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:54.042415 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:54.183499 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:54.191812 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-29f5a194-779b-456b-b63c-086c89d8bd8f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1754 microversion: 2.1 time: 0.164598 Jun 07 16:08:54.192404 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 535/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:54 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:08:55.209826 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:08:55.210440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:08:55.212824 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:08:55.218133 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:55.218581 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:55.219370 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:08:55.219805 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:08:55.366002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:08:55.373972 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9182933a-7116-4e9a-b2dc-b883eb2d6f0a tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1757 microversion: 2.1 time: 0.168010 Jun 07 16:08:55.374536 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 516/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:08:55 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 16:09:05.860970 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:05.861515 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:05.863504 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:05.864386 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=24 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:05.870637 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:05.871080 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:05.871837 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:05.872831 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:05.954034 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lazy-loading 'services' on Instance uuid a7e500b3-762c-4156-aa55-3ca4020cc797 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:09:06.023704 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-8cd09c7d-b7a0-4a59-a0ba-b7a9c02a50b1 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797/os-volume_attachments/9c0c78cc-7449-4d07-af1d-66785f9b24ef" status: 202 len: 0 microversion: 2.1 time: 0.166955 Jun 07 16:09:06.024291 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 536/1052] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:09:05 2022] DELETE /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797/os-volume_attachments/9c0c78cc-7449-4d07-af1d-66785f9b24ef => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:09:07.135440 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:07.135981 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:07.139019 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:07.139664 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:07.146058 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:07.146569 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:07.147363 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:07.147792 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:07.174390 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:09:07.248820 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-f097cacb-eca1-4a6e-b9d7-a99b198b4867 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 204 len: 0 microversion: 2.1 time: 0.116673 Jun 07 16:09:07.249698 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 517/1053] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:09:07 2022] DELETE /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:09:07.259002 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:07.259786 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:07.267150 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:07.267631 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:07.268423 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:07.268875 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:07.396094 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:07.404062 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-b3dbeb35-8e7f-4a2f-a51e-aa32e83b7f53 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1514 microversion: 2.1 time: 0.149209 Jun 07 16:09:07.404660 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 537/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:07 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:08.421381 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:08.421999 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:08.428470 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:08.428922 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:08.429707 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:08.430146 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:08.567262 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:08.574714 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-72e69163-6325-4604-9e5a-3ec46374f1f7 tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1514 microversion: 2.1 time: 0.158219 Jun 07 16:09:08.575278 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 518/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:08 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:09.591085 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:09.591693 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:09.598610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:09.599061 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:09.599849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:09.600231 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:09.642552 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-eeabfe13-1216-4a53-ae40-d668ae7a5073 req-d8dddf51-4eab-430d-af80-ef0bdf30e417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e500b3-762c-4156-aa55-3ca4020cc797", "name": "network-vif-deleted", "tag": "d02120f0-8cec-44c2-bf07-7b48d8f0a577"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:09:09.651921 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-eeabfe13-1216-4a53-ae40-d668ae7a5073 req-d8dddf51-4eab-430d-af80-ef0bdf30e417 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:09.652284 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-eeabfe13-1216-4a53-ae40-d668ae7a5073 req-d8dddf51-4eab-430d-af80-ef0bdf30e417 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:09.663667 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-eeabfe13-1216-4a53-ae40-d668ae7a5073 req-d8dddf51-4eab-430d-af80-ef0bdf30e417 service nova] Creating event network-vif-deleted:d02120f0-8cec-44c2-bf07-7b48d8f0a577 for instance a7e500b3-762c-4156-aa55-3ca4020cc797 on hv-cinder-84487 Jun 07 16:09:09.668611 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-eeabfe13-1216-4a53-ae40-d668ae7a5073 req-d8dddf51-4eab-430d-af80-ef0bdf30e417 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030459 Jun 07 16:09:09.669166 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 519/1056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 16:09:09.676964 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8725c1db5ee3468d881a42a3f2df50ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab43bc41a9b44512b7e3e4c1f721bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:09.684785 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-dc6c48eb-a9ee-4616-a0da-f0c04a2311da tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 200 len: 1472 microversion: 2.1 time: 0.097552 Jun 07 16:09:09.685426 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 538/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:09 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:10.703862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:10.704620 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] [instance: a7e500b3-762c-4156-aa55-3ca4020cc797] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:10.711193 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:10.711665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:10.712435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:10.712874 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:10.726639 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.wsgi [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] HTTP exception thrown: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Request method failure captured: Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: request: GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 HTTP/1.1 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept: application/json Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Accept-Encoding: identity Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Connection: close Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Length: 0 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Content-Type: application/json Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Host: 10.222.0.18 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Openstack-System-Scope: None Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: User-Agent: python-urllib3/1.26.9 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Auth-Token: gAAAAABin3fB0TbTK0U5OJQ9y-gMLeFf6ajjTpGrny10Q2Abk1Ad4ZvLNGaC2U_a6mzTMVmRDhDnfLcKQ2Sy4E6eSd0u9td0sDOD6THcSEAyOujR2BJG7qnhdPbeQIvQcI4eSSvsMYuDWptm1KPBt7VTxiU3lKAnfflXK_RQuLPaDMBj96HlZt4 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Id: None Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Domain-Name: None Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Identity-Status: Confirmed Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Is-Admin-Project: True Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Id: default Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Domain-Name: Default Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Id: ab43bc41a9b44512b7e3e4c1f721bacf Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Role: reader,member Jun 07 16:09:10.728242 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Roles: reader,member Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab43bc41a9b44512b7e3e4c1f721bacf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab43bc41a9b44512b7e3e4c1f721bacf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Id: ab43bc41a9b44512b7e3e4c1f721bacf Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1473457464 Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User: tempest-VolumesSnapshotTestJSON-1473457464-project Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Id: default Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Domain-Name: Default Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Id: 8725c1db5ee3468d881a42a3f2df50ea Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: X-User-Name: tempest-VolumesSnapshotTestJSON-1473457464-project Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: method: > Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: exception: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. Jun 07 16:09:10.729733 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: action_args: {'id': 'a7e500b3-762c-4156-aa55-3ca4020cc797'} Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:09:10.730533 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. Jun 07 16:09:10.732127 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: ERROR nova.api.openstack.wsgi Jun 07 16:09:10.734002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] Returning 404 to user: Instance a7e500b3-762c-4156-aa55-3ca4020cc797 could not be found. {{(pid=117819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:09:10.734002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d049fcfc-01ed-42be-bd6b-1d621f6942ba tempest-VolumesSnapshotTestJSON-1473457464 tempest-VolumesSnapshotTestJSON-1473457464-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797" status: 404 len: 111 microversion: 2.1 time: 0.031235 Jun 07 16:09:10.734002 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 520/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:10 2022] GET /compute/v2.1/servers/a7e500b3-762c-4156-aa55-3ca4020cc797 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:09:15.366361 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:09:15.366904 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Tue Jun 7 16:09:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 16:09:34.090246 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-744824152"}} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:09:34.090958 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:34.092829 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_api:SELECT=6 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:34.093482 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG dbcounter [-] [117818] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:34.100166 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:34.100644 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:34.101410 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:34.101849 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:34.228792 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.network.security_group_api [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Removing security group 96af920b-90d8-4ec6-bd97-9e1eedb81f8c from port bb394a22-3523-40cd-8341-5b364302539a Jun 07 16:09:34.591341 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-d4b3ae0b-fd17-4250-a096-f901f8b59bea tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action" status: 202 len: 0 microversion: 2.1 time: 0.505125 Jun 07 16:09:34.595014 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 539/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 7 16:09:34 2022] POST /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:09:34.601413 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-94400fa0-2b59-4757-8dc7-5b95d340d3a0 req-457ba3cb-f6be-4153-b498-e8344baf6c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:09:34.605721 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:34.607020 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG dbcounter [-] [117819] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 16:09:34.614597 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-94400fa0-2b59-4757-8dc7-5b95d340d3a0 req-457ba3cb-f6be-4153-b498-e8344baf6c0b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:34.615303 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-94400fa0-2b59-4757-8dc7-5b95d340d3a0 req-457ba3cb-f6be-4153-b498-e8344baf6c0b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:34.629594 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-94400fa0-2b59-4757-8dc7-5b95d340d3a0 req-457ba3cb-f6be-4153-b498-e8344baf6c0b service nova] Creating event network-changed:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:09:34.637795 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-94400fa0-2b59-4757-8dc7-5b95d340d3a0 req-457ba3cb-f6be-4153-b498-e8344baf6c0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041510 Jun 07 16:09:34.638774 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 521/1060] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:09:36.054682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:36.055215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:36.061324 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:36.061777 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:36.062549 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:36.062987 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:36.149640 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.objects.instance [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lazy-loading 'services' on Instance uuid 249e99d7-aebb-46c8-b73d-24d09ddb6b50 {{(pid=117818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 16:09:36.220616 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-7240332f-5098-46cd-b8da-07a219e98929 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments/fb719be1-160f-4011-86aa-9f4c23e8f21f" status: 202 len: 0 microversion: 2.1 time: 0.170733 Jun 07 16:09:36.221203 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 540/1061] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:09:36 2022] DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments/fb719be1-160f-4011-86aa-9f4c23e8f21f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:09:36.231919 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:36.233435 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:36.241976 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:36.242510 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:36.243374 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:36.243880 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:36.277755 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-c9a63730-3993-4692-b95a-7c0bf8c3d90f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051143 Jun 07 16:09:36.278330 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 522/1062] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:09:36 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:09:36.653723 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [req-321cfdd0-d639-40e6-b67c-dcf9754ddf4e req-21288558-158a-4a5f-96cd-98d437e4886b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:09:36.662160 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-321cfdd0-d639-40e6-b67c-dcf9754ddf4e req-21288558-158a-4a5f-96cd-98d437e4886b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:36.662689 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [req-321cfdd0-d639-40e6-b67c-dcf9754ddf4e req-21288558-158a-4a5f-96cd-98d437e4886b service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:36.673682 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.compute.server_external_events [req-321cfdd0-d639-40e6-b67c-dcf9754ddf4e req-21288558-158a-4a5f-96cd-98d437e4886b service nova] Creating event network-changed:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:09:36.679012 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [req-321cfdd0-d639-40e6-b67c-dcf9754ddf4e req-21288558-158a-4a5f-96cd-98d437e4886b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029284 Jun 07 16:09:36.679913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 541/1063] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:09:37.289451 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:37.290403 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:37.296915 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:37.297359 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:37.298169 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:37.298601 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:37.327775 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-a2e1381a-24b9-46f2-8546-e1b58b7d0e25 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042332 Jun 07 16:09:37.328334 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 523/1064] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 7 16:09:37 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 16:09:37.340007 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:37.340623 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:37.347436 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:37.347881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:37.348673 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:37.349103 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:37.422751 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] HTTP exception thrown: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 is not attached to volume fb719be1-160f-4011-86aa-9f4c23e8f21f Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Request method failure captured: Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments/fb719be1-160f-4011-86aa-9f4c23e8f21f HTTP/1.1 Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3ehAL5IDfmdb9osIlQ1s_QS5-n7KfeGRYVDFOXeZG3noMwYAd-Er99IxeZ_q80fnSc5l8-tEoBPvRmAzYYD11vEHIj7V69bIkTx_Xmcwu5X0ynGhWSqzHvB7y1_Dsy-ocIxf7nKMwxfwHU1yKwSetKWlMYqApipzikdMWlQMQmBdgo Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 0598199897de4461b994edd96e987dfb Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:09:37.427610 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0598199897de4461b994edd96e987dfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0598199897de4461b994edd96e987dfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0598199897de4461b994edd96e987dfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0598199897de4461b994edd96e987dfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 0598199897de4461b994edd96e987dfb Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestMinimumBasicScenario-442367085-project Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: bce573cefd1641559d57ba0b0d2a8b3c Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestMinimumBasicScenario-442367085-project Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:09:37.429793 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 is not attached to volume fb719be1-160f-4011-86aa-9f4c23e8f21f Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'server_id': '249e99d7-aebb-46c8-b73d-24d09ddb6b50', 'id': 'fb719be1-160f-4011-86aa-9f4c23e8f21f'} Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fb719be1-160f-4011-86aa-9f4c23e8f21f. Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:09:37.430579 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 is not attached to volume fb719be1-160f-4011-86aa-9f4c23e8f21f Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 is not attached to volume fb719be1-160f-4011-86aa-9f4c23e8f21f Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:37.431879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Returning 404 to user: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 is not attached to volume fb719be1-160f-4011-86aa-9f4c23e8f21f {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:09:37.434063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-63f58468-0a56-43ba-bffa-c3161f449621 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments/fb719be1-160f-4011-86aa-9f4c23e8f21f" status: 404 len: 154 microversion: 2.1 time: 0.094472 Jun 07 16:09:37.434063 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 542/1065] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 7 16:09:37 2022] DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50/os-volume_attachments/fb719be1-160f-4011-86aa-9f4c23e8f21f => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:09:38.584862 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:38.585368 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:38.591275 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:38.591716 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:38.592484 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:38.592915 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:38.617410 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Going to try to terminate instance {{(pid=117819) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 16:09:38.693499 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-d0f48c7b-2409-4359-ada2-a0241757d552 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 204 len: 0 microversion: 2.1 time: 0.113286 Jun 07 16:09:38.694269 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 524/1066] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 7 16:09:38 2022] DELETE /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 16:09:38.702881 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:38.703596 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:38.710879 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:38.711319 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:38.712072 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:38.712539 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:38.839476 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:38.847405 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-9b567fcd-f5ae-4681-ad2e-7487c5585e54 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1552 microversion: 2.1 time: 0.148110 Jun 07 16:09:38.847963 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 543/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:38 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:39.866105 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:39.866751 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.compute.api [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117819) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:39.873213 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:39.873665 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:39.874417 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:39.874853 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:40.004936 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.policy [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117819) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:40.012342 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-9597c910-ed6c-4288-a40a-47c426b2507f tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1552 microversion: 2.1 time: 0.151178 Jun 07 16:09:40.012924 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 525/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:39 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:41.030696 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:41.031245 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:41.038650 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:41.039109 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:41.039894 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:41.040339 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:41.255836 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.policy [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bce573cefd1641559d57ba0b0d2a8b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0598199897de4461b994edd96e987dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117818) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 16:09:41.263545 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-2617296b-954f-4ad6-b7c7-363356d78208 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 200 len: 1552 microversion: 2.1 time: 0.236879 Jun 07 16:09:41.264215 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 544/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:41 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 1552 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 16:09:41.584643 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [req-c8fa27b0-c563-4552-81fe-048e8c3067b6 req-16a54041-23f3-4938-82a8-20410bacb844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249e99d7-aebb-46c8-b73d-24d09ddb6b50", "name": "network-vif-deleted", "tag": "bb394a22-3523-40cd-8341-5b364302539a"}]} {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 16:09:41.593407 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-c8fa27b0-c563-4552-81fe-048e8c3067b6 req-16a54041-23f3-4938-82a8-20410bacb844 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:41.593891 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG oslo_concurrency.lockutils [req-c8fa27b0-c563-4552-81fe-048e8c3067b6 req-16a54041-23f3-4938-82a8-20410bacb844 service nova] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:41.606315 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.compute.server_external_events [req-c8fa27b0-c563-4552-81fe-048e8c3067b6 req-16a54041-23f3-4938-82a8-20410bacb844 service nova] Creating event network-vif-deleted:bb394a22-3523-40cd-8341-5b364302539a for instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 on hv-cinder-84487 Jun 07 16:09:41.611423 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [req-c8fa27b0-c563-4552-81fe-048e8c3067b6 req-16a54041-23f3-4938-82a8-20410bacb844 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155641 Jun 07 16:09:41.612003 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 526/1070] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 7 16:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 16:09:42.279913 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '>' {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:42.280552 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.compute.api [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] [instance: 249e99d7-aebb-46c8-b73d-24d09ddb6b50] Fetching instance by UUID {{(pid=117818) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 16:09:42.287848 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:42.288291 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:42.289078 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 16:09:42.289510 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG oslo_concurrency.lockutils [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Lock "de9e0058-8556-4496-a4e0-0705454b303e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 16:09:42.302655 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.wsgi [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] HTTP exception thrown: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Request method failure captured: Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: request: GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 HTTP/1.1 Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept: application/json Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Accept-Encoding: identity Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Connection: close Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Length: 0 Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Content-Type: application/json Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Host: 10.222.0.18 Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Openstack-System-Scope: None Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: User-Agent: python-urllib3/1.26.9 Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Auth-Token: gAAAAABin3ehAL5IDfmdb9osIlQ1s_QS5-n7KfeGRYVDFOXeZG3noMwYAd-Er99IxeZ_q80fnSc5l8-tEoBPvRmAzYYD11vEHIj7V69bIkTx_Xmcwu5X0ynGhWSqzHvB7y1_Dsy-ocIxf7nKMwxfwHU1yKwSetKWlMYqApipzikdMWlQMQmBdgo Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Id: None Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Domain-Name: None Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Identity-Status: Confirmed Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Is-Admin-Project: True Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Id: default Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Domain-Name: Default Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Id: 0598199897de4461b994edd96e987dfb Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Project-Name: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Role: reader,member Jun 07 16:09:42.304163 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Roles: reader,member Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0598199897de4461b994edd96e987dfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0598199897de4461b994edd96e987dfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0598199897de4461b994edd96e987dfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0598199897de4461b994edd96e987dfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Id: 0598199897de4461b994edd96e987dfb Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-Tenant-Name: tempest-TestMinimumBasicScenario-442367085 Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User: tempest-TestMinimumBasicScenario-442367085-project Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Id: default Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Domain-Name: Default Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Id: bce573cefd1641559d57ba0b0d2a8b3c Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: X-User-Name: tempest-TestMinimumBasicScenario-442367085-project Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: method: > Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: exception: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. Jun 07 16:09:42.305825 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: action_args: {'id': '249e99d7-aebb-46c8-b73d-24d09ddb6b50'} Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: {{(pid=117818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 16:09:42.306906 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. Jun 07 16:09:42.308497 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: ERROR nova.api.openstack.wsgi Jun 07 16:09:42.310173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: DEBUG nova.api.openstack.wsgi [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Returning 404 to user: Instance 249e99d7-aebb-46c8-b73d-24d09ddb6b50 could not be found. {{(pid=117818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 16:09:42.310173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO nova.api.openstack.requestlog [None req-f8171119-774f-4e21-a072-819da2ee92e3 tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50" status: 404 len: 111 microversion: 2.1 time: 0.029575 Jun 07 16:09:42.310173 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: [pid: 117818|app: 0|req: 545/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 7 16:09:42 2022] GET /compute/v2.1/servers/249e99d7-aebb-46c8-b73d-24d09ddb6b50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 16:09:42.316501 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: DEBUG nova.api.openstack.wsgi [None req-8b2e1031-8840-4832-adb8-5bd2c7f7eada tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] Calling method '.version_select at 0x7f14485cadc0>' {{(pid=117819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 16:09:42.334522 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO nova.api.openstack.requestlog [None req-8b2e1031-8840-4832-adb8-5bd2c7f7eada tempest-TestMinimumBasicScenario-442367085 tempest-TestMinimumBasicScenario-442367085-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-109819258" status: 202 len: 0 microversion: 2.1 time: 0.022639 Jun 07 16:09:42.335014 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: [pid: 117819|app: 0|req: 527/1072] 10.222.0.18 () {58 vars in 1268 bytes} [Tue Jun 7 16:09:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-109819258 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 16:12:23.812408 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:12:23.812959 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Tue Jun 7 16:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 16:12:26.341820 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:12:26.342496 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Tue Jun 7 16:12:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 16:12:35.374585 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:12:35.375348 dv-cinder-844879-2-iscsi devstack@n-api.service[117818]: Tue Jun 7 16:12:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 16:12:39.429762 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:12:39.430316 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Tue Jun 7 16:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 16:13:47.549101 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 16:13:47.549772 dv-cinder-844879-2-iscsi devstack@n-api.service[117819]: Tue Jun 7 16:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!